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I  Introduction 


The  accelerating  and  almost  unbelievable  rate 
of  change  in  our  society  has  had  a  profound  effect 
on  our  social  institutions.  They  are  faced  not 
only  with  innovations  in  science  and  technology , 
but  also  with  changing  values  and  concepts  con¬ 
cerning  the  nature  of  man  [Margulies  and  Raia, 

1972s 1J. 

The  basic  result  of  this  rapidly  changing  environment 
has  been  considerable  changes  in  how  organizations  function 
and  in  what  "types"  of  organizations  are  most  successful.  A 
study  of  early  human  history  shows  us  that  changes  in  social, 
economic  and  technological  areas  came  slowly  in  discrete 
steps.  Since  the  early  1900's,  however,  a  type  of  "time" 
compression  has  taken  place.  Changes  now  come  much  closer 
together  and  tend  to  have  large  impacts  on  the  way  our  world 
operates.  A  major  factor  in  this  time  compression  has  been 
the  advent  of  rapid,  world-wide  communications.  No  longer 
are  people  and  organizations  widely  separated.  Truly  our 
world  has  become  "smaller". 

In  early  human  history  organizations  were  mechanis¬ 
tic  in  nature  having  been  founded  on  military  style  organiza¬ 
tions.  The  environment,  by  today's  standard,  was  predicta¬ 
ble,  stable  and  very  slow  to  change  in  either  social,  eco¬ 
nomic,  or  technological  areas.  As  communications  improved 
and  technology  advanced,  mechanistic  organizations  found 
themselves  faced  with  increasingly  dynamic  environments. 


The  lack  of  flexibility  often  found  in  mechanistic  organiza¬ 
tions  began  to  erode  their  capability  to  cope  and  survive. 

Margulies  and  Raia  state: 

Older  mechanistic  organization  structures  are 
gradually  giving  way  to  newer  and  more  organic  tem¬ 
porary  systems  and  matrix  forms  ....  The  concept 
of  man  as  an  inert  instrument  to  be  manipulated  and 
controlled  by  the  organization  has  become  obsolete. 

The  depersonalized  values  of  bureaucratic  systems 
are  gradually  being  replaced  by  organizational 
values  based  upon  humanistic  and  democratic  ideals 
[Margulies  and  Raia,  1972:1]. 

Basically  organizations  are  now  recognizing  the  im¬ 
portance  of  the  human  aspects  in  how  they  function.  This 
recognition,  in  addition  to  the  rapid  technology  changes  has 
forced  managers  to  consider  changing  their  organization. 
Change  in  itself  is  another  characteristic  of  organizations. 
Albanese  states: 

The  fact  of  change  needs  no  proof  because  it  is 
immediately  and  continuously  evident  to  the  senses. 

We  may  not  like  change.  We  may  not  know  exactly 
what  is  changing.  The  meaning  of  changes  may  not 
be  clear.  We  may  not  know  how  to  respond  to  the 
changes.  However,  one  thing  is  clear.  Change  is  a 
fact.  Response  to  change  is  an  essential  require¬ 
ment  of  organizational  effectiveness  [Albanese, 
1978:555-556]. 

A  medical  analogy  can  be  used  to  describe  the  cur¬ 
rent  organizational  dilemma.  Organizations  are  bom,  they 
grow,  and  tragically  they  sometimes  die.  In  the  commercial 
world  the  death  can  be,  and  usually  is,  quick.  Marginal 
commercial  organizations  that  fail  to  change  to  improve  ef¬ 
fectiveness  do  not  survive  long.  In  non -commercial  areas, 
such  as  the  federal  government,  the  actual  organizational 
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death  may  never  come.  Instead  a  "lingering"  illness  may  be 
the  rule.  This  non-commercial  problem  is  even  more  danger¬ 
ous  and  costly  than  the  commercial  problem  due  to  the  far 
reaching  economic  consequences  of  ineffective  government 
organizations. 

Organizational  effectiveness  itself,  as  a  concept, 
presents  a  problem  in  terms  of  definition.  Generally  organ¬ 
izational  effectiveness  is  stated  in  terms  of  goals/objec- 
tives  accomplishment.  Criteria  are  developed  from  the  stated 
goals  of  the  organization  to  provide  measures  of  effective¬ 
ness.  With  commercial  organizations  criteria  such  as  profit, 
production  rates,  cost,  et  cetera  provide  easily  measurable 
criteria  by  which  effectiveness  can  be  judged.  Commercial 
organizations  have  the  "market  test"  which  provides  judgment 
on  performance.  People  vote  in  the  market  by  buying  or  not 
buying  goods  and  services.  In  the  case  of  public  goods, 
i.e.  defense,  the  market  test  fails.  Government  organiza¬ 
tions,  particularly  those  engaged  in  Research  and  Develop¬ 
ment  (R&D)  have  problems  with  criteria  selection  since  they 
lack  a  definitive  product  or  products.  Multiple  criteria 
are  required  because  no  one  criteria  is  likely  to  cover  all 
aspects  of  an  organization.  Criteria  for  R&D  type  organiza¬ 
tions  as  well  as  other  "public"  organizations  tend  to  be 
vague  and  difficult  to  measure.  Criteria  such  as  efficiency 
of  budget  use  and  schedule  accomplishment  are  often  utilized 
by  government  organizations  in  lieu  of  criteria  which  are 
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more  closely  aligned  with  goals.  Budget  use  and  schedules 
are  easily  measured  while  the  quality  of  a  technology  is 
difficult  to  quantify. 

Due  to  Congressional  action  in  terms  of  laws  used  to 
establish  government  organizations,  it  is  nearly  impossible 
to  terminate  such  organizations  for  failing  to  be  effective. 
In  fact,  it  may  be  undesirable  to  terminate  a  government  or¬ 
ganization  which,  by  some  criteria,  is  failing  to  perform 
some  vital  functions .  If  a  commercial  store  goes  out  of 
business,  there  are  generally  many  others  which  not  only 
fill  the  gap  but  may  have  been  responsible  for  the  demise  of 
the  competitor.  This  is  not  usually  the  case  with  government 
organizations.  The  only  solution  available,  for  government 
organizations,  to  the  problem  of  improving  effectiveness  is 
changing  the  organization  and  even  then  the  methods  are 
often  limited  by  law  or  regulation. 

An  important  question  arises  here.  Must  an  organiza¬ 
tion  make  changes  just  for  the  sake  of  change?  No!  Random 
and  unneeded  changes  can  cause  as  many  problems  as  not 
changing  when  needed.  The  key  is  for  an  organization  to 
recognize  when  change  is  required,  what  changes  are  needed, 
and  what  tools  are  to  be  used.  This  is  a  problem  of  con¬ 
siderable  magnitude.  The  increased  concern  over  the  human¬ 
istic  aspects  of  organization  has  only  enlarged  the  problem. 
As  Dekok  puts  it  in  his  thesis,  "Organizations  quickly  real¬ 
ized  that  concomitant  with  capital  investment  in  new 


processes,  materials,  and  equipment  came  a  new  type  of  in¬ 
vestment  --  in  human  capital  [Dekok,  1979:1-2]." 

Human  labor  accounts  for  large  percentages  of  organ¬ 
izational  costs.  In  the  Department  of  Defense  (DOD),  the 
percentage' exceeds  50%.  These  facts  have  led  to  increased 
emphasis  on  how  to  alter  the  humanistic  processes  in  organ¬ 
izations  in  order  to  improve  effectiveness.  Changes  in  how 
society  views  the  nature  of  man  have  led  to  many  changes  in 
the  composition  of  our  workforce  and  in  what  that  workforce 
expects  from  participation  in  organizations.  This  has  also 
been  a  powerful  force  in  changing  our  organizations.  As 
stated  by  Dekok,  "Increasingly  top  management  was  faced  with 
unrest  in  this  new  workforce  --  a  situation  which  manifested 
itself  in  turnovers,  absenteeism,  and  low  productivity  [Dekok, 
1979:2]." 

Organizations  have  found  themselves  faced  with  mas¬ 
sive  and  complex  structural  and  human  organizational  problems. 
Most  organizations  and  their  managers  were  not  equipped  to 
cope  with  the  changes  required  or  even  to  know  which  tools 
to  utilize.  Out  of  this  environment  has  come  a  multitude  of 
behavioral  science  approaches  and  management  consultants 
designed  to  help  an  organization  cope  with  change  and  to 
improve,  hopefully,  its  effectiveness.  For  as  stated  by 
Albanese:  "Presumably  the  reason  for  changing  or  developing 
organizations  is  to  make  them  more  effective.  Organizational 
effectiveness  is  the  ’bottom  line’  [Albanese,  1978:570]." 
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The  Nature  of  Organizational 
Development 

In  the  mid  1940 's  a  new  field  arose  in  response  to 
the  rapidly  changing  environment  which  provided  tools  aimed 
at  the  humanistic  side  of  organizations.  At  that  time  Kurt 
Lewin  and  his  associates  began  looking  at  the  use  of  small 
discussion  groups  to  change  behavior.  They  were  innovators 
in  the  field  that  was  to  become  known  as  organizational  de¬ 
velopment  (0D)  (Albanese,  1978:56?). 

There  are  three  basic  approaches  for  initiating 
change  in  organizations: 

(1)  changing  the  individuals  who  work  in  the 
organization, 

(2)  changing  specific  organizational  structures 
and  systems,  and 

(3)  changing  directly  the  overall  climate  and 
interpersonal  style  which  characterize  an  organiza¬ 
tion  [Porter  et  al.,  1975*.439], 

0D  initially  tended  to  involve  techniques  which  utilized 
approach  three  (3)  above,  a  basically  humanistic  approach. 
Modern  0D  also  includes  approaches  one  (1)  and  two  (2) 
thereby  including  human  processual  as  well  as  technostruc- 
tural  methods  (Porras  and  Berg,  1978).  This  has  caused  con¬ 
siderable  confusion  as  to  exactly  what  0D  encompasses.  0D 
started  out  under  the  human  process  approach;  however,  in 
recent  years,  practitioners  using  structural  approaches 
such  as  job  enrichment,  job  redesign  and  organizational  re¬ 
design  have  used  the  0D  banner  with  the  resultant  confusion 
(Dekok,  1979:11). 
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For  the  most  part,  OD  views  an  organization  in  a 
humanistic/organic  sense.  OD’s  management  approach  is  along 
the  lines  of  McGregor's  Theory  Y  and  Likert's  System  Four. 
OD's  philosophy,  thus,  involves  a  humanism  approach  to 
changing  organizations.  In  this  trait  lies  its  basic  popu¬ 
larity.  People  want  to  be  treated  as  people  and  individuals 
rather  than  interchangeable  subunits.  This  is  the  basic 
reason  for  revolts  against  the  "Scientific  Management"  ap¬ 
proach. 


OD  Definition.  Defining  OD  is  a  considerable  problem 
due  to  the  wide  variety  of  development/change  techniques 
referred  to  as  OD.  Albanese  defines  OD  ass 

...  a  management-supported,  systems  approach 
to  planned  organization  change  that  utilizes  behav¬ 
ioral  science  knowledge  as  a  major  means  of 
achieving  the  goal  of  greater  organizational  effec¬ 
tiveness  [Albanese,  1978:5663. 

French  and  Bell  define  OD  slightly  differently: 

Organizational  development  is  a  long  range 
effort  to  improve  an  organization's  problem-solving 
and  renewal  processes,  particularly  through  a  more 
effective  and  collaborative  management  of  organiza¬ 
tion  culture-with  special  emphasis  on  the  culture 
of  formal  work  terms  --  with  the  assistance  of  a 
change  agent,  or  catalyst,  and  the  use  of  the 
theory  and  technology  of  applied  behavioral  science, 
including  action  research  [French  and  Bell,  1973:15]* 

Campbell  excludes  technostructural  interventions  from  his 

definition  of  OD  (Campbell,  1977:31). 

The  definition  first  proposed  by  Bechard  and  later 
used  by  Porter,  et  al.  and  Dekok  is  used  in  this  paper: 
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Organization  development  is  an  effort  (1)  planned, 

(2)  organization-wide  and  (3)  managed  from  the  top 
to  (4)  increase  organizational  effectiveness  and 
health  through  (4)  planned  interventions  in  the  or¬ 
ganization's  "processes"  using  behavioral  science 
knowledge  [Beckhard,  1969,  Ch  2:9]. 

Organization  Change  Model.  Time  is  an  important 
variable  in  the  organizational  change  model.  Only  French 
and  Bell,  in  the  above  definitions,  refer  to  time.  They  use 
the  words  "long  range  effort".  Likert  also  realized  the 
importance  of  time  in  modelling  organizational  change.  He 
defined  three  types  of  variables:  causal,  intervening,  and 
end-result.  Causal  variables  were  defined  as  those  which 
could  be  altered  or  changed  by  the  organization.  Intervening 
variables  included  attitudes,  motivations,  perceptions,  et 
cetera  and  end  result  variables  were  along  the  lines  of  pro¬ 
ductivity,  costs,  and  so  on  (Likert,  1967:26-29;  Dekok, 
1979:7). 

Likert's  model  as  adapted  by  Dekok  is  shown  in 
Figure  1. 


Figure  1.  Organizational  Change  Model 
(Dekok,  1979:7) 
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What  this  figure  illustrates  is  that  Likert's  model 
suggests  that  changes  in  managerial  behavior,  caused  by  OD, 
will  affect  subordinates  perceptions  about  the  organization 
and  result  in  a  changed  organization.  This  will  hopefully 
lead  to  positive  changes  in  productivity.  This  model  is  im¬ 
portant  because  the  evaluation  of  the  Air  Force  Flight 
Dynamics  Laboratory  (AFFDL)  OD  program  has  been  done  par¬ 
tially  from  this  viewpoint.  It  should  also  be  noted,  at 
this  point,  that  intensity  or  strength  of  a  change  causing 
process  such  as  OD  is  an  important  factor  in  determining  how 
rapidly  changes  in  the  organization  and  productivity  are 
seen.  Clearly,  time  is  an  important  element.  As  stated  by 
Likert: 


The  available  evidence  indicates  that  there 
are  consistent  and  dependent  relationships  among 
the  causal,  intervening,  and  end-result  variables. 

When  all  of  the  relevant  factors  are  taken  into 
consideration,  especially  time  and  the  proper 
analyses  made,  consistent,  positive  relationships 
can  be  expected  among  the  causal,  intervening, 
and  end-result  variables  in  every  organization  .  .  . 
the  closer  two  variables  are  in  causal -intervening - 
end  result  sequence  .  .  .  the  more  marked  the  rela¬ 
tionships  tend  to  be.  The  farther  apart  the  vari¬ 
ables  are  in  the  sequence  and  the  greater  the  prob¬ 
able  time  interval  between  changes  in  the  other, 
the  lower  the  correlations  tend  to  be  [Likert, 
1967:98-99,  81], 

The  OD  effort  underway  at  AFFDL  has  been  in  progress 
for  over  four  years  and,  therefore,  provided  an  opportunity 
to  check  the  above  model  via  a  longitudinal  analysis  which 
is  described  in  Chapter  II,  Research  Methodology.  The  re¬ 
mainder  of  this  section  briefly  reviews  OD’s  processes, 
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assumptions,  values,  and  objectives  and  then  looks  at  one 
particular  OD  intervention,  team  building,  and  finally  pre¬ 
sents  a  short  look  at  the  importance  and  role  of  the  pro¬ 
fessional  OD  change  agent. 

OD  Characteristics.  In  terms  of  OD  characteristics 


Albanese  states: 

Additional  insight  into  OD  is  gained  by  noting 
several  of  its  characteristics.  OD  change  efforts 
often  use  the  services  of  a  third-party  change 
agent  or  OD  consultant.  OD  implies  a  relatively 
long-term  and  on-going  process.  It  emphasizes  the 
importance  of  goal-setting  and  planning  activities. 

OD  is  associated  with  skills  and  techniques  aimed 
at  developing  more  effective  work  groups  or  teams 
[Albanese,  1978:566]. 

Even  though  the  above  is  not  the  definition  Albanese 
uses  for  OD  it  contains  most  of  the  key  elements  from  the 
OD  definition  used  in  this  report. 

OD  Assumptions .  As  with  any  program,  OD  contains 
several  key  assumptions.  Beckhard  lists  six  (6)  assumptions 
which  are  representative  of  lists  used  by  other  authors: 

1.  The  basic  building  blocks  of  an  organiza¬ 
tion  are  groups  (teams).  Therefore,  the  basic 
units  of  change  are  groups,  not  individuals. 

2.  An  always  relevant  change  goal  is  the  re¬ 
duction  of  inappropriate  competition  between  parts 
of  an  organization  and  the  development  of  a  more 
collaborative  condition. 

3.  Decision-making  in  a  healthy  organization 
is  located  where  the  information  sources  are, 
rather  than  in  a  particular  role  or  level  of  hier¬ 
archy  . 

4.  Organizations,  subunits  of  organizations, 
and  individuals  continuously  manage  their  affairs 
against  goals.  Controls  are  interim  measurements, 
not  the  basis  of  managerial  strategy. 
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5-  One  goal  of  a  healthy  organization  is  to 
develop  generally  open  communication,  mutual  trust, 
and  confidence  between  and  across  levels. 

6.  "People  support  what  they  help  create". 

People  affected  by  a  change  must  be  allowed  active 
participation  and  a  sense  of  ownership  in  the  plan¬ 
ning  and  conduct  of  change  [Beckhard,  1969s 9]. 

The  above  assumptions  are  critical  in  that  they  set 
the  stage  for  what  type  of  techniques  are  used  and  how  they 
are  applied  to  the  problem  of  organizational  change  and  ef¬ 
fectiveness.  Many  basic  assumptions  about  OD  lie  along  the 
lines  of  McGregor's  "Theory  Y"  assumptions .  Beckhard' s 
list  is  certainly  not  all  inclusive  but  is  representative. 
Examples  of  other  assumptions  listed  by  Wendell  French  in¬ 
cludes 


.  Most  people  desire  to  make,  and  are  capable 
of  making  higher  contributions  to  organization 
goals 

.  Most  people  wish  to  be  accepted  and  to  work 
cooperatively  with  at  least  one  small  group 

.  The  work  group  is  a  vitally  important  re¬ 
ference  group 

.  The  level  of  interpersonal  trust  is  much 
lower  than  it  should  be  in  most  organizations 
[French,  1969 « 3^]. 

OD  Objectives.  The  question  of  what  OD  is  supposed 
to  accomplish  is  contained  within  the  wide  variety  of  ob¬ 
jective  lists  contained  in  the  literature.  A  list  which 
contains  the  basic  elements  of  most  other  authors  is  pro¬ 
vided  by  French « 

1)  To  increase  the  level  of  trust  and  support 
among  organizational  members. 

2)  To  increase  the  incidence  of  confrontation 
of  organizational  problems,  both  within  groups 

and  among  groups,  in  contrast  to  "sweeping  problems 
under  the  rug". 


11 


3)  To  create  an  environment  in  which  authority 
of  assigned  role  is  augmented  by  authority  based 
on  knowledge  and  skill. 

4)  To  increase  the  openness  of  communication 
laterally,  vertically  and  diagonally. 

5)  To  increase  the  level  of  personal  enthusiasm 
and  satisfaction  in  the  organization. 

6)  To  find  synergistic  solutions  to  problems 
with  greater  frequency. 

7 T  To  increase  the  level  of  self  and  group  re¬ 
sponsibility  in  planning  and  implementation  [French, 
196902]. 

The  above  list  of  objectives  helps  to  define  the  in¬ 
tent  of  OD  in  the  most  general  terms.  More  specific  objec¬ 
tives  often  develop  following  discussions  with  specific  or¬ 
ganizations  . 

OD  Values.  Beneath  the  sets  of  assumptions  and  ob¬ 
jectives  for  OD  lie  certain  values.  As  stated  by  French  and 
Bell,  "While  scientific  inquiry,  ideally,  is  value  free,  the 
applications  of  science  are  not  value  free  [French  and  Bell, 
1973*71]."  A  set  of  values  for  change  agents  widely  quoted 
in  literature  also  comes  from  French  and  Bells 

1)  The  needs  and  aspirations  of  human  beings  are 
the  reasons  for  organized  effort  in  society. 

2)  Life  can  become  richer  and  more  meaningful, 
and  organized  effort  more  effective  and  enjoyable, 

if  feelings  and  sentiments  are  permitted  to  be  a  more 
legitimate  part  of  the  culture  of  organizations. 

3)  Commitment  to  an  action  role,  along  with  a 
commitment  to  research,  in  an  effort  to  improve  the 
effectiveness  of  organizations. 

4)  Democratization  of  organizations  or  one  power 
equalization  [French  and  Bell,  1972:72]. 

The  above  sets  of  values,  assumptions,  and  objectives 
for  OD  are  certainly  not  all  inclusive  but  they  are  repre¬ 
sentative  of  what  is  generally  found  in  OD  literature. 
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They  are  also  vitally  important  because  they  form  the  foun¬ 
dation  for  the  entire  OD  area  of  knowledge  and  application 
and  from  them  comes  the  multitude  of  techniques  for  inter¬ 
ventions.  The  values,  assumptions  and  objectives  of  OD  must 
be  made  explicit  to  clients  of  change  agents  to  ensure  a 
meaningful  OD  process  can  take  place. 

The  OD  Process.  As  explained  by  French  and  Bell, 

'‘OD  as  an  operational  process  was  seen  to  possess  three  basic 
components:  the  diagnostic,  the  action  (or  intervention),  and 
the  process -maintenance  components.  .  .  [French  and  Bell, 
1973:623.”  A  large  number  of  sources  use  diagnosis  and  ac¬ 
tion  intervention  as  phases  of  the  OD  process.  The  major 
differences  among  authors  concerning  the  OD  process  is  the 
number  of  steps  or  phases  involved.  Most,  however,  lie  along 
the  lines  proposed  by  Lewin: 

A  change  toward  a  higher  level  of  group  per¬ 
formance  is  frequently  short-lived;  after  a  "shot 
in  the  arm",  group  life  returns  to  the  previous 
level.  This  indicates  that  it  does  not  suffice 
to  define  the  objectives  of  planned  change  in  a 
group’s  performance  as  the  reaching  of  a  different 
level.  Permanency  of  the  new  level,  or  permanency 
for  a  desired  period,  should  be  included  in  the 
objective.  A  successful  change  includes,  therefore, 
three  aspects:  unfreezing  (if  necessary)  the  pre¬ 
sent  level,  moving  to  the  new  level,  and  the 
freezing  of  group  life  to  the  new  level  [French, 

Bell,  and  Zawacki,  1978:70]. 

Note  that  while  diagnosis  is  not  explicitly  a  part 
of  the  above  process  definition  action  intervention  is 
roughly  equal  to  the  moving  phase  and  process-maintenance  is 
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basically  equivalent  to  the  freezing  phase.  As  pointed  out, 
other  authors  include  more  steps  but  the  general  approach 
remains  close  to  the  above  concepts. 

OP  Techniques.  There  are  a  large  number  of  inter¬ 
vention  (action)  techniques  available  to  the  OD  practitioner 
(ODP)  for  use  in  the  "moving"  or  "action"  phase  of  the  OD 
process  once  the  critical  "diagnostic"  stage  has  been  com¬ 
pleted.  In  looking  at  Table  I,  the  reader  should  remember 
that  structural  as  well  as  humanistic  approaches  are  cur¬ 
rently  included  under  the  OD  banner  as  previously  discussed. 

Table  I 

OD  Intervention  Techniques 
.  T-groups 

.  Laboratory  Training 
.  Job  enrichment 
.  Managerial  Grid 
.  Conflict  Training 
.  Rate  Analysis 
.  Transactional  Analysis  (TA) 

.  Team  Building 
.  Sensitivity  Analysis 
.  Management  by  Objectives  (MBO) 

Table  I  is  meant  only  to  illustrate  examples  of  the 
wide  range  of  tools  the  ODP  has  available  to  him.  There  are 
many  more  techniques  (interventions)  than  those  included  in 
Table  I.  There  is  also  the  rather  complex  problem  of  clas¬ 
sifying  OD  interventions.  One  of  the  most  successful  clas¬ 
sification  schemes  is  found  in  a  work  by  Miles  and  Schmuck 
(1976)  called  the  "OD  Cube"  which  use  three  (3)  classifica¬ 
tion  axes  called:  Diagnosed  Problems,  Focus  of  Attention 
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(i.e.  person,  group,  etc.),  and  Mode  of  Intervention  (i.e. 
training,  goalsetting,  etc.).  The  reader  is  referred  to  his 
article  for  further  information. 

Team  Building.  As  stated  by  McGill,  "Team  building 
is  the  single  most  popular  approach  to  OD  used  today  [McGill 
1977:77]."  Part  of  the  definition  of  team  building  is  con¬ 
tained  in  its  name.  By  its  very  nature  team  building  works 
with  natural  work  groups.  As  defined  by  Franch  and  Bell, 
team  building  activities  are: 

Activities  designed  to  enhance  the  effective 
operation  of  system  teams.  They  may  relate  to  task 
issues,  such  as  the  way  things  are  done,  the  needed 
skills  to  accomplish  tasks,  the  resource  allocations 
necessary  for  task  accomplishment;  or  they  may  re¬ 
late  to  the  nature  and  quality  of  the  relationships 
between  the  team  members  or  between  members  and  the 
leader  [French  and  Bell,  1973:102-103]. 

The  reason  for  expanding  on  this  particular  interven 
tion  is  twofold:  (1)  It  is  the  most  popular  intervention; 

(2)  It  is  the  intervention  being  used  in  the  OD  program  at 
AFFDL.  The  goals/objectives  of  team  building  are  similar  in 
nature  to  those  found  for  OD  in  general: 

1.  Understanding,  mutual  agreement  and  identi¬ 
fication  regarding  goals  to  the  group. 

2.  Open  communication 

3.  Mutual  trust 

4.  Mutual  support 

5.  Effective  management  of  conflict 

6.  Developing  a  selective  and  appropriate 
use  of  team  concept  [McGregor,  1967]. 

French  and  Bell  state  that  team  building  interven¬ 
tions  are  basically  aimed  at  four  major  areas:  diagnosis, 
task  accomplishment,  team  relationships,  and  team  and 
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organization  processes.  French  and  Bell  set  these  four  areas 
within  family  groups  and  special  groups  as  separate  considera¬ 
tions.  Family  groups  are  basically  on-going,  intact  and 
somewhat  permanent  work  groups  while  special  groups  may  be 
newly  formed  or  transient  in  nature  (French  and  Bell,  1 973s 
112-113) . 

Porter  et  al.  provided  three  general  approaches  to 
accomplishing  team  building*. 

1)  Survey  -  Feedback  -  discussion  -  action  planning 
techniques  which  involve  a  consultant's  helping  the  group 
collect  information  about  the  way  the  group  operates,  feeding 
this  data  back  to  the  group,  discussing  the  information  and 
making  action  plans  to  improve  the  group. 

2)  Process  consultation  technique  which  involves  a 
flexible  and,  many  times,  ad  hoc  set  of  consultative  inter¬ 
ventions  designed  to  help  a  group  understand  and  do  something 
positive  concerning  its  problems. 

3)  The  interpersonal  approach  utilizes  the  T-group 
or  laboratory  education  method  (Porter,  et  al.,  1975). 

The  OP  Practitioner  (ODP).  Concerning  team  building 
activities  Porter  et  al.  state,  "Almost  all  team  building 
activities  take  place  with  the  active  assistance  of  a  con¬ 
sultant  skilled  in  working  with  groups  [Porter  et  al.,  1975s 
459]."  Dekok  in  his  thesis  work  on  the  AFFDL  OD  program 
states: 
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In  OD  theory  organizational  change  is  induced 
by  an  OD  practitioner  (ODP)  who  is  also  referred 
to  as  a  "consultant" ,  "change  agent",  or  "interven¬ 
tionist"  .  His  role  is  one  of  diagnosis,  prescrip¬ 
tion,  and  facilitation.  The  tools  he  possesses  to 
accomplish  these  tasks  are  many  and  varied,  ranging 
from  "sensitivity  training"  on  one  extreme  to  "job 
redesign"  on  the  other  hand  [Dekok,  1979:57]* 

The  ODP's  role  in  OD  interventions  is  vital  to  suc¬ 
cess.  A  good  ODP  is,  however,  a  necessary  but  not  suffi¬ 
cient  condition  for  a  successful  OD  program.  It  has  been 
shown  in  previous  sections  of  this  report  that  the  ODP  has 
a  multitude  of  tools  to  choose  from  when  considering  how  to 
improve  an  organization.  The  ODP  is  usually  external  to  the 
organization  (i.e.  not  a  member)  and  is  a  professional  be¬ 
havioral  science  expert  and  management  consultant.  The  ODP's 
first  task,  and  perhaps  the  most  critical,  is  to  "diagnose" 
the  organization  via  any  of  a  variety  of  analysis  techniques 
including  interviews,  surveys,  et  cetera.  The  ODP  must  de¬ 
termine  first  if  a  problem  really  exists  and  if  one  does 
exist,  the  ODP  must  define  its  characteristics  and  causes. 

The  results  of  the  above  process  will  lead  the  ODP  to 
select  from  his  "tools"  the  proper  intervention s)  to  ac¬ 
complish  the  desired  goals.  However,  as  stated  by  Dekok, 

The  nature  of  the  treatment(s)  are  ODP-dependent . 

Some  practitioners  have  developed  confidence  in  a 
few  methods  (or  perhaps  even  a  single  one)  which 
they  have  found  appropriate  for  a  wide  variety  of 
organizational  problems  [Dekok,  1979:35]* 

Once  an  appropriate  intervention! s)  is  selected  the 
ODP  now  provides  the  "catalyst"  to  begin  the  "moving", 
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"action",  or  "unfreezing"  stage.  The  ODP  also  provides  a 
control  function  to  ensure  the  intervention  is  kept  on  track. 
Finally  the  ODP  must  work  to  make  the  results,  hopefully 
good  of  course,  self-sustaining.  This  is  then  entering  the 
"process  maintenance",  or  "re-freezing"  stage. 

For  the  above  process  to  have  any  chance  of  success, 
the  ODP  must  establish  a  strong  "trust"  relationship  with 
the  client  organization.  OD  can  be  viewed,  by  organiza¬ 
tional  members,  in  a  negative  fashion  as  an  unwelcome  in¬ 
trusion  on  their  lives  and  "kingdoms".  Although  a  manager 
may  call  in  an  ODP,  he/she  may  be  reluctant  to  be  completely 
open  about  problems  in  the  organization.  In  short,  the  po¬ 
tential  for  conflict  is  present  which  may  limit  the  ODP  in 
how  useful  an  OD  program  can  be  established.  Walton  (cited 
in  Bowen,  1977:546-73)  indicated  that  such  conflict  can 
arise  from  five  basic  types  of  inconsistencies: 

1.  An  inconsistency  may  exist  between  the  goals  and 
strategies  of  the  client  and  the  values  of  the  consultant. 

2.  The  client's  actions  in  implementing  the  OD  pro¬ 
gram  may  be  inconsistent  with  the  goals  and  values  of  the 
consultant. 

3-  There  may  be  a  difference  between  the  conse¬ 
quences  of  the  intervention  and  the  consultant’s  personal 
values . 

4.  There  may  be  a  difference  between  the  consultant's 
behavior  and  accepted  professional  standards. 
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5.  The  consequences  of  an  intervention  may  be  incon¬ 
sistent  with  the  values  generally  identified  with  OD. 

Dekok  summarises  the  ODP's  problem  well  in  the  fol¬ 
lowing  statements 

In  summary,  the  ODP  is  in  an  unenviable  position 
within  his  own  profession.  Even  though  his  tool 
kit  contains  an  assortment  of  potent  instruments, 
his  profession  has  often  not  provided  him  with  the 
training  necessary  to  diagnose  or  treat  the  assort¬ 
ment  of  maladies,  he  is  likely  to  encounter.  Worse 
yet,  his  patient  is  unlikely  to  be  of  much  assist¬ 
ance  in  the  diagnosis  or  the  course  of  treatment, 
and  the  treatment  (once  chosen)  is  unlikely  to 
produce  measurable  effects  (if  any)  for  several 
years  after  it  was  started  [Dekok,  1979:  ^3-^0  ■ 

OD  Effectiveness.  Measuring  the  effectiveness  of 
OD  intervention  is  a  problem  of  considerable  magnitude. 

While  several  past  attempts  have  indicated  positive  changes 
in  organizations  due  to  an  OD  program  (Bowers,  1973;  Porras 
and  Berg,  1978),  nearly  all  such  analysis  efforts,  have  suf¬ 
fered  from  the  same  research  problems:  small  sample  sizes, 
poor  research  designs,  lack  of  statistical  control  and  the 
inpreciseness  inherent  in  measuring  organizational  change 
(Dekok,  1979:58). 

As  stated  previously  in  this  thesis  the  bottom  line 
in  OD  is  improving  organizational  effectiveness.  Measuring 
the  change  in  organizational  effectiveness  and,  therefore, 
the  effectiveness  of  an  OD  intervention s)  is  a  problem  of 
immense  magnitude.  The  foundation  of  OD  established  earlier 
in  this  thesis  indicates  that  measures  in  at  least  two  areas 
are  vital  to  judging  the  effectiveness  of  OD  in  changing 
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organizational  effectiveness:  (1)  intervening  variables  such 
as  organizational  climate  and  (2)  end-result  variables  such 
as  productivity  measures.  Measurement  of  changes  in  organ¬ 
izational  climate  (OC)  and  productivity  presents  extremely 
complex  problems.  These  measurement  problems  are  compounded 
in  a  military  Research  and  Development  (R&D)  laboratory  such 
as  the  Air  Force  Flight  Dynamics  Laboratory  (AFFDL)  due  to  a 
lack  of  a  definitive  product  on  the  order  that  commercial 
firms  produce.  OC  creates  a  measurement  problem  in  that  it 
is  a  "warm  fuzzy"  area  that  is  not  clearly  defined  and  can, 
depending  on  the  author,  be  viewed  either  as  an  organiza¬ 
tional  characteristic  or  as  an  attribute  of  the  perceiving 
individual.  (Dekok,  1979 s 203-204) .  The  questionnaire  used  in 
the  research  effort  on  AFFDL 's  OD  program  is  discussed  in 
Chapter  II,  Research  Methodology.  Using  Likert’s  model  of 
the  organizational  change  process  presented  earlier,  one 
should  agree  that  most  OD  interventions  are  aimed  at  alter¬ 
ing  OC  via  individual  perception  changes  which  hopefully  re¬ 
sult  in  increased  productivity  and,  therefore,  a  more  effec¬ 
tive  organization.  The  problems  of  measurement  stated  above 
only  serve  to  complicate  the  goal  of  determining  if  OD  has 
any  lasting  value.  In  view  of  the  dollars  being  spent  on 
OD,  53  million  in  1977  by  DoD  (Dekok,  1979) »  some  methods 
must  be  found  to  ensure  that  organizations  truly  benefit  by 
this  process  and  expenditure. 
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Summary .  The  discussion  in  this  section  on  the 
nature  of  organizational  development  (OD)  was  not  intended 
to  he  exhaustive.  It  was  meant  only  to  orient  the  reader  to 
the  general  subject  area.  For  a  far  more  complete  discussion 
of  OD,  organizational  climate,  and  organizational  effective¬ 
ness,  the  reader  is  urged  to  consult  Dekok's  thesis,  Chapter 
II  and  Appendix  B,  or  any  of  the  other  sources  listed  in  the 
bibliography  of  this  thesis.  A  brief  review  of  Dekok's 
thesis  on  the  AFFDL  OD  program  is  presented  later  in  this 
Chapter . 

OD  can,  properly  implemented,  provide  a  powerful 
tool  for  improving  an  organization  in  today's  rapidly  chang¬ 
ing  environment.  Its  emphasis  on  humanistic  values  with  a 
mixture  of  structural  considerations  offers  a  wide  range  of 
techniques  to  choose  from  to  accomplish  the  goals  of  any  OD 
program.  The  role  of  an  OD  practitioner  (ODP)  is  vital  in 
the  entire  OD  process  and  a  positive,  trusting  link  between 
the  organization  and  the  ODP  is  critical  to  success.  Meas¬ 
uring  OD  intervention  effectiveness  is  hampered  by  many  fac¬ 
tors  including  the  problems  inherent  in  measuring  organiza¬ 
tional  climate  and  productivity. 

Background  on  OD  at  AFFDL 

As  mentioned  in  the  preceeding  discussion  on  OD  and 
today's  environment,  OD  represents  a  wide  range  of  tools  for 
dealing  with  the  wide  variety  of  organizational  problems 
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faced  today.  The  military  as  well  as  the  business  and  aca¬ 
demic  worlds  have  used  and  continue  to  use  OD  and  the  ODP  to 
improve  organizational  effectiveness.  Within  the  Air  Force 
Wright  Aeronautical  Laboratories  (AFWAL)  complex  at  Wright- 
Patterson  Air  Force  Base,  Ohio,  several  laboratories  in¬ 
cluding  the  Air  Force  Materials  Laboratory  (AFML)  and  the 
Air  Force  Aero  Propulsion  Laboratory  (AFAFL)  have  used  OD 
programs  in  the  1971-1975  time  period.  The  popularity  of 
those  OD  interventions  led  AFFDL,  in  1976,  to  contract  with 
Dr.  George  Lehner,  a  nationally  known  ODP,  to  set  up  an  OD 
program  for  AFFDL. 

Dr.  Lehner  began  the  diagnostic  stage  of  OD  by  inter¬ 
viewing  personnel  in  the  laboratory  for  individual  percep¬ 
tions  of  organizational  problems.  Following  discussions  with 
AFFDL  management  concerning  the  above  interviews  as  well  as 
about  AFFDL's  goals  for  the  OD  program,  it  was  decided  that 
team  building  would  accomplish  their  goals.  Concerning  the 
goals  (objectives)  of  the  AFFDL  OD  program  Dekok  points  out 
that: 

Although  the  goals  of  the  team  development  ef¬ 
fort  were  not  formally  documented,  "goals  of  peo¬ 
ple  working  harder,  or  better,  or  feeling  better 
about  the  laboratory  were  verbalized  (Stahl,  et.  al, 
1978:2)"  subsequently  in  discussions  with  research¬ 
ers  [Dekok,  1979:4]. 

The  approach  selected  by  the  ODP,  Dr.  Lehner,  in¬ 
volves  visitations  by  him  to  the  laboratory,  usually  two 
days  at  a  time,  for  a  total  of  16  days  per  year.  The  AFFDL 
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team  building  intervention  is  rather  flexible  and  unstruc¬ 
tured  in  nature  utilizing  meetings  between  Dr.  Lehner  and 
selected  groups  and  committees  within  the  laboratory.  Some 
of  the  groups  involved  in  the  program  include: 

1.  Branch  Chief's  Council 

2.  Corporate  Board 

3.  Professional  Advisory  Group 

k .  Woman's  Seminar  (Now  the  Women's  Action  Board) 

5.  Division  and  Branch  level  training  (Dekok,  1979*5) 

The  AFFDL  program  is  conducted  as  a  completely  vol¬ 
untary  program.  AFFDL  management  and  Dr.  Lehner  took  great 
care  to  ensure  that  no  pressure  was  placed  on  personnel  to 
attend  OD  sessions.  Two  divisions  out  of  the  four  main  AFFDL 
product  divisions  elected  not  to  participate  in  the  OD  pro¬ 
gram.  It  was  this  particular  arrangement  at  AFFDL- -two  divi¬ 
sions  participating  and  two  not — that  offered  an  unusual  op¬ 
portunity  to  use  a  research  design  which  would  aid  in  elim¬ 
inating  many  of  the  problems  faced  by  previous  researchers. 
This  research  design  is  discussed  in  Chapter  II,  Research 
Methodology . 

As  stated  in  the  previous  discussion  on  the  nature  of 
OD  and  team  building,  Dr.  Lehner' s  techniques  involve  aspects 
of  the  humanistic  side  of  organizations  rather  than  struc¬ 
tural  considerations  which  are  very  difficult  to  alter  in 
government  areas.  As  a  result  of  his  approach  and  the  values 
and  objectives  inherent  in  the  team  building  techniques, 


Dr.  Lehner  seeks  to  improve  the  interpersonal  part  of  the 
AFFDL  organizational  environment  which  involves  improving 
group  communication  and  relationships. 


The  team  building  intervention  at  AFFDL  is  still 
underway  in  1980.  There  has  been  increased  interest  in  OD 
at  the  APWAL  level  with  a  staff  member  established  to  look 
at  OD  programs  for  all  the  laboratories. 

History  of  the  Current 
Research  Effort 

Do  OD  interventions  actually  provide  any  measurable 
benefit  for  the  investment  made  in  time  and  money?  This 
question  lead  Dr.  Lehner  and  the  AFFDL  OD  staff  officer, 

Mr.  Max  Davis,  to  ask  three  AFIT  researchers  (Drs.  Stahl, 
McNichols,  and  Manley),  in  the  summer  of  1977,  to  conduct  an 
assessment  of  the  program.  The  next  step  as  stated  by  Dekok: 

After  discussion  with  the  principals,  the  AFIT 
researchers  formulated  a  multivariate  model  of  or¬ 
ganizational  effectiveness  based  on  a  model  by 
Kilman  and  Herden  for  evaluating  the  impact  of  in¬ 
terventions  on  organizational  effectiveness  [Dekok, 
1979:6]. 

The  AFIT  researchers  prepared  a  survey  instrument, 
based  on  the  above  model,  which  was  designed  to  measure  job 
satisfaction,  job  motivation,  organizational  climate,  and 
productivity  in  addition  to  providing  demographics.  The 
baseline  measurement  was  taken,  via  the  survey  instrument, 
between  Christmas  1977  and  mid-January  1978  by  the  original 
AFIT  researchers.  The  second  measurement  was  conducted  from 


24 


Christmas,  1978  to  mid-January,  1979  "by  Major  Roger  Dekok 
who  conducted  the  first  longitudinal  analysis  of  the  data. 

A  complete  discussion  of  the  research  design  and  survey  in¬ 
strument  is  contained  in  Chapter  II.  The  next  section  of 
this  chapter  provides  a  brief  review  of  Dekok’ s  results. 

Summary  of  Results  from  1979 
AFFDL  Research  Effort 

Following  collection  of  the  second  set  of  measure¬ 
ment  data  in  early  1979,  Dekok  evaluated  the  effectiveness  of 
the  AFFDL  team  building  program  using  one  primary  and  one 
secondary  hypothesis? 

Primary  Hypothesis 

Divisions  which  are  involved  in  the  team  develop¬ 
ment  effort  showed  more  positive  change  on  criterion 
variables  than  divisions  which  are  not  involved  in 
the  OD  program. 

Secondary  Hypothesis 

Intervening  variables  (primarily  those  associated 
with  organizational  climate;  exhibited  less  positive 
change  than  end-result  variables  (productivity  and 
absenteeism)  [Dekok,  1979* 9l* 

A  longitudinal  analysis  was  conducted  by  examining 
the  change  from  1978  to  1979  on  eleven  criterion  variables: 
employee  job  satisfaction,  job  motivation,  and  absenteeism; 
five  factor  dimensions  of  organizational  climate?  and  for 
scientists  and  engineers  (S&E’s),  three  productivity  fac¬ 
tors  (Dekok,  1979).  Selection  of  the  criterion  variables 
was  based  on  the  goals  stated  for  the  OD  program  at  AFFDL 
and  on  a  factor  analysis  (principal  component)  of  the 
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combined  1978  and  1979  data.  Dekok  concluded,  as  a  result 
of  his  analysis  of  the  measurements ,  that  the  OD  program  at 
AFFDL  could  be  having  a  measurable  positive  effect  in  some 
areas,  particularly  communication  and  absenteeism.  However, 
he  stated  that  due  to  the  weakness  of  the  OD  intervention, 
i.e.  lack  of  intensity,  effects  were  slow  in  evolving  and  an 
additional  measurement  and  analysis  would  be  required  to 
accomplish  the  following  objectives: 

.  1.  Confirm  or  deny  that  the  process  of  OD  in¬ 
duced  organizational  change  is  still  occurring 
within  the  laboratory. 

2.  Observe  if  more  of  the  perceptual  measures 
exhibit  statistically  significant  changes  over  a 
two  year  period  (3  measurements). 

3*  Resolve  the  absenteeism  issue  for  FE  and  FG 
(the  two  divisions  using  OD  out  of  four  AFFDL  divi¬ 
sions).  Confirm  or  deny  that  this  is  an  effect  that 
can  be  unequivocally  attributed  to  the  OD  program. 

4.  Observe  if  the  fall  in  the  scores  of  FX 
(non-OD  division)  on  the  immediate  work  group  dimen¬ 
sion  of  organizational  climate  is  a  continuing 
event,  and  ascertain  its  probable  causes. 

5.  Resolve  the  productivity  issues  for  FE 
and  FG  (productivity  scores  decreased  from  1978 
to  1979  for  these  two  OD  divisions).  Investigate 
whether  productivity  is  a  state  cyclical  variable 
within  AFFDL,  and  if  cyclical,  define  the  period 
[Dekok,  1979]. 

The  above  conclusions  and  results  led  to  the  initia¬ 
tion  of  the  current  1980  research  effort.  Additional  in¬ 
formation  concerning  the  previous  measurements  and  analysis 
can  be  found  in  Major  Dekok' s  thesis  of  the  same  title 
(Dekok,  1979)  and  in  AFIT  Technical  Report  TR-78-3  (Stahl, 
McNichols,  and  Manley,  1978). 
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Statement  of  the  Problem 


This  research  effort  is  designed  to  answer  one  basic 
question*  Has  the  team  building  organizational  development 
(OD)  intervention  at  the  Air  Force  Flight  Dynamics  Labora¬ 
tory  (AFFDL)  had  any  measurable  effect  on  the  various  organ¬ 
izational  goals  that  were  stated  for  the  program?  In  addi¬ 
tion  this  research  effort  has  the  five  sub-objectives  stated 
in  the  previous  section  of  this  chapter. 

Scone  and  Limitations 

This  research  effort  is  to  be  confined  to  AFFDL  and 
its  particular  OD  intervention.  No  attempt  will  be  made  to 
generalize  any  results  to  any  other  OD  program  in  any  other 
organization. 

Hyno theses 

A  primary  and  secondary  hypothesis  were  tested  in 
this  research  effort.  The  primary  hypothesis  was* 

Divisions  which  are  involved  in  the  team  development 
effort  showed  more  positive  change  on  criterion  variables 
than  divisions  which  are  not  involved  in  the  OD  program. 

The  secondary  hypothesis  was* 

Intervening  variables  (primarily  those  associated 
with  organizational  climate)  exhibited  less  positive  change 
than  end-result  variables  (productivity  and  absenteeism) . 
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II  Research  Methodology 


Introduction 


The  previous  chapter  mentioned  that  many  research 
efforts  on  the  effectiveness  of  OD  have  faced  significant 
problems  such  as  small  sample  size,  poor  research  design, 
and  lack  of  statistical  control.  These  problems,  as  well  as 
others,  severely  limited  the  usefulness  of  most  other  studies 
on  OD.  The  research  efforts  on  the  team  building  interven¬ 
tion  at  AFFDL  have  attempted  to  avoid  or  minimize  these  pro¬ 
blems.  Major  Dekok  in  his  research  effort  during  1979  de¬ 
scribed  the  general  approach  ass 

...  a  longitudinal,  quasi -experimental  re¬ 
search  design  employing  control  groups  was  used  to 
eliminate  many  of  the  alternative  causes  for  any 
observed  change;  standard,  validated  measures  of 
organizational  performance  and  process  variables 
were  used  whenever  possible;  and,  statistical  con¬ 
trol  was  employed  to  ensure  that  any  observed  changes 
were  significant  and  not  due  to  sampling  error 
[Dekok,  1979:59]. 

This  chapter  reviews  and  discusses  the  research  de¬ 
sign,  questionnaire,  measures  of  organizational  change,  and 
the  statistical  and  analytic  techniques  used  in  support  of 
the  hypotheses  and  objectives  of  this  research. 


Research  Design 

As  discussed  in  Chapter  I,  the  OD  program  at  AFFDL 
was  voluntary  in  nature.  Two  of  the  four  product  divisions 
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(FE,  Vehicle  Equipment  and  FG,  Flight  Control)  decided  to 
participate  in  the  OD  program  which  has  been  underway  since 
1976  and  is  conducted  by  Dr.  Lehner.  The  remaining  two  di¬ 
visions  (FX,  Aeromechanics  and  FB,  Structural  Mechanics) 
elected  to  not  participate  in  the  team  building  interven¬ 
tion.  This  situation  created  a  natural  treatment  group- 
control  group  experimental  set-up.  The  personnel  of  the  four 
AFFDL  product  divisions  are  the  subjects  for  this  research 
effort.  The  main  thrust  of  this  research  project  was  to  use 
the  treatment  group-control  group  arrangement  to  conduct  a 
longitudinal  comparison  of  data  derived  from  the  survey  in¬ 
struments  and  AFFDL  records. 

Figure  2,  below,  utilizes  the  symbology  of  Campbell 


and  Stanley  (1963)  to  illustrate  the  quasi -experimental  de¬ 
sign  that  was  used  in  this,  and  the  previous,  research  ef¬ 
forts  on  the  AFFDL  program. 


Division 

Jan  78 

Jan  79 

Jan  80 

FE 

X 

o1  X 

°2 

X 

°3 

FG 

X 

X 

°2 

X 

0 

FX 

°2 

0 

FB 

°1 

°2 

°3 

X  =  treatment 

0  =  observation 

Figure  2.  Quasi -Experimental  Research  Design. 
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The  Sample. 

The  Air  Force  Flight  Dynamics  Laboratory  is 
one  of  ten  expertly  staffed  Laboratories  estab¬ 
lished  to  conduct  the  exploratory  and  advanced 
development  programs  of  the  Director  of  Science 
and  Technology,  AFSC  [AFFDL  Brochure,  1976]. 

Nearly  1000  personnel  work  in  this  multimillion  dollar  fa¬ 
cility  located  at  Wright-Patterson  Air  Force  Base  in  Dayton, 
Ohio.  AFFDL  functions  as  the  focal  point  for  all  aspects 
of  flight  vehicle  technology  with  the  exception  of  avionics 
and  propulsion.  Included  in  their  area  of  responsibility  is 
the  vital  work  of  flight  system  integration.  Scientists  and 
engineers  (S&E's)  make  up  almost  half  of  the  assigned  per¬ 
sonnel.  The  four  product  divisions  are  as  follows: 

Structural  Mechanics  (FB):  The  approximately 
280  military  and  civilian  personnel  of  this  divi¬ 
sion  are  primarily  concerned  with  the  safety,  re¬ 
liability,  cost,  and  performance  associated  with 
new  aerospace  vehicle  structures. 

Vehicle  Equipment  (FE):  This  division  is  re¬ 
sponsible  for  advancing  technology  on  flight 
vehicle  equipment  and  subsystems  including  such 
items  as  landing  gears,  windshields,  crew  sur¬ 
vivability,  and  environmental  control.  Approx¬ 
imately  150  personnel  work  in  FE. 

Aeromechanics  (FX):  The  approximately  2?0 
personnel  of  FX  are  involved  in  formulating  and 
directing  development  programs  in  aerodynamics, 
thermodynamics,  performance  analysis,  and  tech¬ 
nology  integration  for  advanced  military  air¬ 
craft  and  missiles. 

Flight  Control  (FG):  This  division  acquires 
and  employs  advanced  technology  to  analyze,  de¬ 
sign,  and  support  the  flight  control  needs  of 
present  and  future  military  aircraft.  Approx¬ 
imately  200  personnel  work  in  FG  [Dekok,  1979*. 6 1"? * 
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Table  II 

Demographic  Data  for  AFFDL  (1980  Sample) 


Question  Description 


AFFDL 

Total 


Age  categorya  4.53  4.87  4.83  4.33  3*94 


Grade  category 

Military0 

8 .60 

8.24 

7.72 

9.00 

9.05 

Civilian0 

4.11 

4.44 

4.00 

3.96 

4.05 

Years  in  Divi- 

d 

sion 

6.02 

6.02 

6.27 

6.10 

5.67 

Length  Assigned 

Labe 

3-61 

3-79 

4.00 

3.65 

2.93 

f 

Education  Level 
Position 

4.90 

4.87 

4.75 

4.83 

5.15 

S&E’s 

192 

50 

58 

32 

52 

Technicians 

57 

18 

22 

11 

6 

Clerk/Steno 

29 

4 

11 

6 

8 

Group  Leaders 

34 

10 

7 

7 

10 

Branch  Chiefs 

15 

2 

4 

3 

6 

Others 

15 

5 

4 

1 

5 

Total 

342 

89 

106 

60 

87 

a  An  average  of  3-0  represents  30-34  years;  4.0  represents 
35-39  years;  5*0  represents  40-44  years. 

b  An  average  of  8.0  represents  T  Sgt  -  CMS;  9-0  represents 
1st  or  2nd  Lt,;  10,0  represents  Capt. 

c  An  average  of  3-0  represents  GS  8-11;  4.0,  GS-12;  5-0, 
GS-13 • 

d  An  average  of  4.0  represents  2  years  but  less  than  3; 

5.0  represents  3  years  but  less  than  4;  6.0  represents 
4  years  but  less  than  5- 

e  An  average  of  2.0  represents  2-5  years;  3*0  represents 
6-10  years;  4.0  represents  11-15  years. 

f  An  average  of  4.0  represents  3S  degree;  5*0  some  grad¬ 
uate  work  (no  degree). 
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As  is  true  with  most  of  the  Air  Force's  laboratories 
AFFDL’s  workforce  is  largely  civilian  (80 %) .  Military  per¬ 
sonnel  do  occupy  positions  at  all  levels  including  S&E’s, 
managers,  and  administrators.  Table  II  contains  the  demog¬ 
raphic  data  for  the  1980  data  sample. 

Data  Collection.  To  date  three  measurements  con¬ 
cerning  the  effectiveness  of  the  0D  program  at  AFFDL  have 
been  made  using  the  questionnaire  described  later  in  this 
chapter.  The  questionnaire  was  designed  to  measure  factors 
such  as  job  satisfaction,  job  motivation,  organizational 
climate  and  productivity.  In  each  case  the  questionnaires 
were  distributed  in  the  last  week  of  December  and  collected 
in  mid- January  of  the  next  year.  Table  III  below  contains 
the  relevant  data  for  each  of  the  three  measurements. 

Table  III 

Data  Collection  (1978,  1979,  1980) 


Collection 

Date 

Number 
Distr . 

Number 

Returned 

Return- 

Rate 

Number 

Usable 

Jan  1978 

583 

380 

65% 

364 

Jan  1979 

663 

426 

6k% 

413 

Jan  1980 

581 

360 

62% 

342 

In  the  January,  1978  measurement  only  FX,  FB,  and  FE 
were  surveyed.  FG  was  added  in  the  January,  1979  and  Jan¬ 
uary,  1980  measurements  so  that  all  four  product  divisions 
were  surveyed.  The  return  rates  in  Table  III  are  considered 
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to  be  good  for  a  voluntary  survey.  The  rate  is  dropping 
off  somewhat,  quite  possibly  because  lab  personnel  have  grown 
tired  of  repeatedly  filling  out  the  same  survey.  A  lack  of 
feedback  of  the  survey  results  to  the  general  work  force  may 
also  be  a  problem.  As  one  respondent  put  it:  "I  have  been 
responding  to  these  questionnaires  for  almost  four  years  with¬ 
out  seeing  any  feedback.  Is  anybody  using  this  survey  for 
anything? " 

Care  was  taken  both  in  the  1979  measurements  and  in 
the  1980  measurement  to  ensure  that  only  the  employees  who 
remained  in  their  respective  divisions  during  the  year  be¬ 
tween  measurements  were  provided  an  opportunity  to  complete 
the  survey  instrument.  Questionnaires  were  not  distributed 
to  new  employees  or  to  employees  wno  transferred  divisions 
during  the  year.  Completion  of  the  instrument  was  voluntary 
with  complete  anonymity  guaranteed.  Therefore  the  longi¬ 
tudinal  nature  of  this  methodology  was  applied  only  in  the 
sense  of  division  membership. 

As sump ti ons .  As  stated  by  Dekok,  there  was  only  one 
assumption  necessary  for  the  use  of  this  research  design  and 
the  statistical  techniques  described  in  this  chapter,  "... 
the  responses  to  the  survey  instrument  are  valid  and  devoid 
of  any  systematic  biases  [Dekok,  1979:64]." 

Limitations .  The  same  four  limitations  which  ap¬ 
plied  to  Dekok’ s  analysis  (1979)  using  this  research  design 
also  apply  to  this  research  effort.  They  are  as  follows: 
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1.  The  design  of  this  research  is  quasi -experimental 
rather  than  true  experimental.  The  reason  for  this  down¬ 
grading  is  that  random  selection  and  assignment  of  personnel 
to  each  of  the  four  divisions  is  not  possible.  The  research 
design  proposed  by  Campbell  and  Stanley  (1963)  and  used  in 
this  research  was  intended  to  control  most  of  the  sources  on 
internal  validity.  There  are,  however,  two  remaining  sources 
of  potential  problems.  As  stated  by  Dekok, 

a.  The  first  of  these  is  the  interaction  of 
selection  with  maturation  of  the  subjects  which 
occurs  when  one  group  has  a  higher  rate  of  matura¬ 
tion  or  autonomous  change  than  another. 

b.  The  second  potential  source  of  internal 
invalidity  for  this  research  design  is  regression 
toward  the  mean.  This  would  be  a  potentially 
serious  source  of  experimental  error  if  any  of 
the  comparison  divisions  were  chosen  on  the  basis 
of  extreme  behavior  on  correlated  effectiveness 
measures  [Dekok,  1979:64]. 

The  first  problem  is  considered  unlikely  due  to  the  demog¬ 
raphic  similarity  of  the  four  divisions  and  AFFDL  managers 
have  assured  the  researchers  that  the  condition  for  the  sec¬ 
ond  problem  is  not  the  case. 

2.  Paired  Sample  Follow-ups  for  individual  responses 
was  not  possible  due  to  the  guarantee  of  anonymity  in  the 
survey.  This  limited  somewhat  the  statistical  power  of  some 
of  the  tests  of  organizational  change  but  did  not  cause  any 
real  difficulties  in  terms  of  the  results  and  conclusions. 

3.  Even  though  FX  and  FB  have  not  been  a  formal 
part  of  the  OD  program  at  AFFDL,  it  was  possible  that  some 
of  the  personnel  from  FX  or  FB  received  some  exposure  to  the 
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program.  Due  to  the  infrequency  and  shortness  of  these 
possible  exposures,  this  was  not  considered  a  problem. 

4.  The  OD  program  at  AFFDL  has  been  in  effect  since 
mid  1976,  almost  two  years  prior  to  the  first  (1978)  meas¬ 
urement.  Therefore  no  pre-OD  baseline  measurement  was  ob¬ 
tained. 

Questionnaire 

The  survey  instrument  included  as  Appendix  A  of  this 
thesis  was  utilized  in  taking  all  three  measurements  used 
in  this  analysis  effort.  The  questionnaire  was  developed, 
following  the  discussion  with  AFFDL  personnel  on  the  goals 
of  the  OD  intervention,  by  Stahl,  McNichols,  and  Manley 
(1978)  using  a  multivariate  model  proposed  by  Kilman  and 
Herden  (1976).  The  instrument  contains  three  basic  sections 
described  as  follows: 

Part  A  contained  seven  questions  designed  to  provide 
demographic  information. 

Part  B  contained  38  questions  designed  to  collect 
information  on  job  satisfaction,  job  motivation,  and  organ¬ 
ization  climate. 

Part  C  contained  13  questions  concerning  productivity 
and  was  to  be  filled  out  by  scientist  and  engineers  (S&E's), 
Group  Leaders,  and  Branch  Chiefs  only.  The  first  five  ques¬ 
tions  required  information  on  how  an  S&E  spends  his/her  time 
time  in  each  area).  The  last  eight  questions  were 
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intended  to  measure  various  types  of  technical  output  or 
products  that  are  tracked  within  the  laboratory. 

Measurement  Scales 

Before  an  analysis  of  the  effectiveness  of  the  AFFDL 
team  building  intervention  could  begin,  the  question  of 
whether  to  analyze  changes  in  specific  questions  or  composite 
measures  had  to  be  resolved.  Two  standard  measures  were  con¬ 
tained  in  the  instrument,  Job  Satisfaction  (Hoppock)  and  Job 
Motivation  (Patchen)  which  are  described  in  the  next  section 
of  this  chapter.  These  standard  measures  avoided  the  dual 
problems  of  validity  and  reliability.  Factor  analytic  tech¬ 
niques  were  used  to  construct  composite  measures  from  the 
remainder  of  the  organizational  climate  questions  and  from 
the  productivity  questions.  The  factors  produced  were  then 
utilized  in  the  remainder  of  the  analysis.  A  limited  valid¬ 
ity  and  reliability  check  was  conducted  for  the  constructed 
factors.  The  following  discussion  deals  first  with  the 
standard  measures  and  then  with  the  constructed  measures. 

In  addition  to  utilizing  the  standard  and  composite  measures 
(factors)  in  the  analysis,  a  decision  was  made  to  look  at 
the  overall  change  in  AFFDL  from  the  first  measurement  in 
1978  to  the  third  measurement  in  1980  via  an  examination  of 
the  responses  (laboratory)  to  all  58  items  in  the  survey. 

Job  Satisfaction.  The  instrument  utilized  in  this 
research  contained  Hoppock 's  (1935)  job  satisfaction  measure. 
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The  measure  is  comprised  of  four  questions  (questions  8-11 
in  section  B  of  the  instrument)  and  has  teen  validated  as 
a  measure  of  a  respondent's  overall  job  satisfaction  by  data 
taken  in  both  military  and  industrial  situations  (McNichols, 
Stahl,  and  Manley,  1978).  The  four  questions  are  combined 
linearly  giving  each  question  equal  weight  which  yielded  a 
scale  score  between  four  and  28. 

Dekok  (1979)  performed  a  principal  component  factor 
analysis  (SPSS  Procedure  PAl)  [Nie  et.  al.  1975]  on  the  four 
Hoppock  questions  using  the  combined  data  from  the  first  two 
AFFDL  measurements  to  confirm  the  validity  of  the  measure. 
The  factor  loadings  obtained  in  addition  to  the  strong  zero 
order  intercorrelations  for  the  four  questions  confirmed  the 
validity  of  Hoppock' s  measure  for  those  data. 

For  this  thesis  an  additional  PAl  analysis  on  the 
four  Hoppock  questions  was  accomplished  utilizing  all  three 
data  sets  to  confirm  the  validity  of  the  Hoppock  measure 
for  this  data  base.  The  first  principal  component  explained 
70.2  percent  of  the  total  variance  in  the  combined  sample 
and  was  the  only  factor  with  an  eigenvalue  greater  than  1.0. 
Table  IV  contains  the  loadings  of  the  four  Hoppock  questions 
on  the  retained  factor  and  the  inter-correlations  for  those 
questions.  As  shown,  the  factor  loadings  are  quite  high, 

.77  to  .90,  and  of  nearly  equal  magnitude.  This  supported 
the  equal  weighting  scheme  used  by  Hoppock  and  other  re¬ 
searchers  for  this  method.  The  high  zero-order 


intercorrelations  provide  another  indication  of  the  validity 
of  this  measure  for  the  AFFDL  sample  (Cronbach  and  Meehl, 
1955). 


Table  IV 

Factor  Loadings  and  Intercorrelations  of  the 
Four  Questions  Comprising  the  Hoppock  Measure 


Questi on 

Factor  Loading 

Intercorrelations 

JL  _2_  -lo. 

(N  =  1061) 

11 

8 

.87 

1.0  .73 

.58 

•  59 

9 

.90 

1.0 

.59 

.6? 

10 

.77 

1.0 

.45 

11 

.80 

1.0 

Job  Motivation.  In  a  similar  fashion  to  Hoppock 's 
measure,  Patchen's  (19^5)  job  motivation  index  is  formed  by 
combining,  linearly,  the  responses  to  four  questions  (ques¬ 
tions  12-15)  after  reversing  the  polarity  of  questions  14 
and  15-  The  result  is  a  scale  score  which  yields  a  range  of 
four  to  20. 

A  PA1  analysis  was  also  conducted  for  the  four  ques¬ 
tions  comprising  the  Patchen  index  using  the  combined  three 
measurement  data  base.  The  analysis  yielded  only  one  factor 
with  an  eigenvalue  greater  than  1.0  and  it  accounted  for 
56.4  percent  of  the  total  variance  in  the  combined  sample. 
Table  V  contains  the  loadings  for  the  four  questions  on  the 
retained  factor  and  the  zero  order  intercorrelations  among 
the  questions. 
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Table  V 

Factor  Loadings  and  Intercorrelations  of  the 
Four  Questions  Comprising  the  Patchen  Measure 


Question 

Factor  Loadings 

Intercorrelations  (N  = 
12  13  14 

106l) 

15 

12 

.75 

1.0 

.53 

•  37 

.34 

13 

.78 

1.0 

.42 

.36 

14 

.75 

1.0 

.48 

15 

.72 

1.0 

The  loadings  are  high  and  of  nearly  equal  magnitude 
which  supports,  as  did  Dekok  (1979) ,  the  use  of  equal  weight¬ 
ing  of  these  questions  in  the  linear  relationship  for  the 
Patchen  index.  The  zero -order  intercorrelations  are  rea¬ 
sonably  high  and  consistent  although  lower  than  those  for 
Hoppock.  As  stated  by  Dekok, 

A  comparison  with  Patchen 's  data  ( 1 96 5 ) *  though 
revealed  that  the  intercorrelations  obtained  in 
this  sample  are  higher  than  those  he  obtained  with 
the  sample  he  used  to  develop  his  measure  [Dekok, 
1979:69]. 

This  same  statement  is  true  for  the  intercorrela¬ 
tions  shown  in  Table  V. 

Organizational  Climate  Factor  Analysis.  The  measure¬ 
ment  of  organizational  climate  (OC)  is  a  difficult  task  at 
best  due  mostly  to  a  lack  of  agreement  as  to  exactly  what 
comprises  OC.  This  difficulty  was  mentioned  in  Chapter  I 
and  is  covered  in  Dekok' s  thesis  (1979) ,  Appendix  3. 


As  described  in  the  previous  section  on  the  question¬ 
naire,  section  B  of  the  survey  contained  the  questions  on  OC 
as  well  as  the  Hoppock  and  Job  Satisfaction  questions. 
Questions  16  through  45  in  the  survey  instrument  were  de¬ 
signed  to  collect  information  on  individual  perceptions  con¬ 
cerning  the  organization's  goals/ob jectives ,  reward  struc¬ 
tures,  supervisor-employee  relationships  and  communications. 

A  PA1  analysis  was  conducted  of  Questions  l6  to  45 
to  examine  first  the  1980  data  alone  and  then  the  combined 
data  base  for  factors  underlying  the  manifestation  variables. 
The  primary  objective  for  this  analysis  was  to  ensure  that 
the  factor  structure  discovered  and  used  by  Dekok  (1979)  in 
his  analysis  had  not  changed  in  its  basic  form.  Dekok,  in 
performing  his  factor  analysis,  stt.  ed  four  basic  questions: 

1.  Identify  the  true  dimensionality  of  the 
responses  to  the  30  questions. 

2.  If  the  dimensionality  was  less  than  30, 
provide  a  reasonable  interpretation  for  the  re¬ 
tained  factors. 

3.  Analyze  the  stability  of  AFFDL's  OC  struc¬ 
ture  over  time,  particularly  the  manifestation 
variables  associated  with  each  retained  factor. 

4.  Examine  the  validity  and  reliability  of 
the  obtained  OC  factors  as  reasonable  criterion 
variables  for  the  OD  effectiveness  research 
[Dekok,  1979:70-71]. 

The  above  four  steps  were  accomplished  in  this  analysis  with 
the  objective  of  examining  the  effects  of  adding  the  1980 
data  base  to  the  existing  AFFDL  (1978,  1979)  sample. 

OC  Dimensionality.  Dekok 's  1978  factor  analysis 
produced  five  factors  with  eigenvalues  greater  than  1.0, 
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accounting  for  56.1  percent  of  the  variance.  His  1979  fac¬ 
tor  analysis  produced  six  factors  with  eigenvalues  greater 
than  1.0,  accounting  for  59*2  percent  of  the  variance.  The 
sixth  factor  retained  from  the  1979  analysis  provided  no 
real  interpretive  power  to  the  factor  structure  and  had  an 
eigenvalue  only  slightly  greater  than  1.0  (1.07).  In  view 
of  this,  Dekok  decided  to  drop  the  sixth  factor  and  retain 
only  the  first  five  factors  which  introduced  no  ambiguities 
into  the  factor  interpretations  (Dekok,  1979:71).  A  factor 
analysis  of  the  1980  data  yielded  six  factors  with  eigen¬ 
values  greater  than  1.0,  accounting  for  60.6  percent  of  the 
total  variance  in  the  30  questions.  As  with  Dekok' s  analy¬ 
sis,  the  sixth  retained  factor  provided  little  added  inter¬ 
pretive  power  and  only  barely  exceeded  an  eigenvalue  of  1.0 
(1.002),  The  1980  analysis  confirms  the  dimensionality 
yielded  by  Dekok' s  previous  analysis. 

PC  Factor  Interpretation.  Utilizing  the  dimension¬ 
ality  results  from  the  above  analysis,  a  PA1  factor  analy¬ 
sis  was  then  performed  on  the  combined  data  sample  which 
forced  retention  of  five  factors  accounting  for  55 per¬ 
cent  of  the  total  variance  in  the  0C  questions  (16-45).  The 
solution  generated  was  rotated  using  Varimax  orthogonal  rota¬ 
tion  with  Kaiser  normalization.  Appendix  3  contains  the  re¬ 
sultant  factor  structure  with  loadings  of  .4  or  greater 
underlined.  Table  VI  contains  the  results  of  using  a  0.4 
cutoff  to  determine  which  variables  to  use  in  explaining  a 
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factor.  The  names  provided  for  each  factor  were  suggested 
by  Dekok  (1979)  and  reflect  the  nature  of  the  questions 
which  loaded  on  each  factor.  The  results  shown  in  Table  VI 
are  virtually  identical  to  those  produced  by  Dekok  (1979* 
Table  XI)  with  one  minor  exception.  Q  39  (Influence  Deci¬ 
sion)  which  loaded  at  0.45  on  Factor  One  (Immediate  Work 
Group)  for  the  combined  (1978,  79*  80)  three  measurement 
analysis  in  the  current  research,  loaded  at  0.43  on  Facxor 
Two  (Employee/Supervisor  Interaction)  in  Dekok's  (1979) 
analysis.  This  switch  is  not  surprising.  The  ability  of  an 
employee  to  influence  decisions  could  be  perceived  by  one 
employee  to  be  part  of  his  immediate  work  group  while  an¬ 
other  employee  may  view  it  as  an  element  of  his/her  inter¬ 
action  with  the  supervisor.  The  above  perception  may  depend 
on  how  decisions  are  arrived  at  within  the  group  (i.e.  the 
process  itself).  Other  than  the  above  difference,  the  fac¬ 
tor  interpretation  and  structure  remained  the  same  as  Dekok's 
(1979) . 

Four  manifestation  variables  exhibited  complexities 
greater  than  one.  Questions  29*  33,  4l,  and  43  had  loadings 
greater  than  0.4  on  two  factors.  As  with  the  switch  of  Q  39 
discussed  above,  this  could  indicate  an  interpretation  pro¬ 
blem  with  these  questions.  Individuals  responding  to  the 
survey  may  have  viewed  these  questions  in  different  ways 
(i.e.  perceived  them  differently).  These  four  questions  did 
not,  however,  cause  any  problems  with  interpretation  of  the 
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involved  factors.  Two  questions,  Q  17  and  Q  27,  had  enough 
ambiguity  involved  to  prevent  them  from  loading  greater  than 
0.4  on  any  factor  so  they  were  removed  from  the  analysis. 

PC  Stability.  As  discussed  in  the  section  on  Dimen¬ 
sionality,  the  organizational  climate  factor  structure  has 
remained  remarkably  stable  from  measurement  to  measurement. 
Appendix  B  contains  the  factor  structure  and  associated 
loadings  for  the  PA1  analysis  of  the  1980  data  sample  with 
five  factors  retained.  The  similarity  of  this  dimensional¬ 
ity  with  the  1978  and  1979  analyses  accomplished  by  Dekok 
(1979,  Appendix  C)  leads  to  the  conclusion  that  the  OC  is 
very  stable  and  the  reliability  of  the  survey  instrument  is 
quite  acceptable. 

Factor  Scores  vs.  Scale  Scores  (OC).  Once  the  OC 
factors  were  identified,  there  were  two  possible  approaches 
to  calculating  "scores"  on  each  factor  for  further  analysis. 
Standardized  factor  scores  (mean  equals  zero,  variance  equal 
one)  could  be  calculated  for  each  respondent  using  the 
FACSCORE  capability  of  SPSS  (Nie  et  al . ,  19 n5) -  The  other 
alternative  is  to  create  scale  scores  by  linearly  combining 
the  variables  in  each  factor  using  equal  weights  for  each 
variable  (i.e.  in  the  same  fashion  as  the  Hoppock  and  Patchen 
measures).  From  an  interpretability  viewpoint,  scale  scores 
were  preferred  for  this  analysis.  It  is  difficult  to  attach 
meaning  to  a  factor  score  even  though  factor  scores  are  sim¬ 
ple  to  handle  statistically. 
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The  first  step  in  determining  if  scale  scores  could 


be  utilized  was  to  examine  the  loadings  of  the  variables  com¬ 
prising  a  factor  on  that  factor.  Using  the  0.4  selection 
rule  ensured  that  all  loadings  were  reasonably  high.  As 
far  as  equality  of  variable  loadings  within  a  particular 
factor  is  concerned  they  are  reasonably  close  to  the  same 
magnitude  although  some  of  the  "spreads"  are  larger  than 
would  be  considered  ideal. 

To  resolve  the  issue  a  second  test  proposed  by  Jum 
Nunnally  (1967)  was  utilized.  To  calculate  the  reliability 
of  a  measure,  Nunnally  proposed  use  of  a  formula  for  coef¬ 
ficient  alpha  developed  by  Cronbach  (1951): 

k  ^ 
rkk  "  k-1  (  1  "  2  ^ 

y 

[Nunnally,  1967: 196j 


Where : 


rkk  =  Coefficient  alpha 

k  =  Number  of  items  in  measure 
2 

177^  =  Sum  of  the  variances  of  individual  items 


_  2  =  Variance  of  the  sum  of  the  items  (measure) 

y 

As  stated  by  Nunnally, 

It. represents  the  expected  correlation  of  one 
test  with  an  alternative  form  containing  the  same 
number  of  items  ....  It  is  so  pregnant  with 
meaning  that  it  should  be  routinely  applied  to 
all  new  tests  [Nunnally,  1967:1961. 


Basically  coefficient  alpha  provides  an  indication  of  whether 
or  not  a  combination  of  variables  are  measuring  the  same 
underlying  factor,  for  example:  Organizational  Warmth.  Values 
for  coefficient  alpha  can  range  from  zero  to  one  with  higher 
values  indicating  higher  reliability.  Coefficient  alphas 
were  calculated  for  each  of  the  five  OC  factors  as  scale 
scores  with  the  results  shown  in  Table  VII. 


Table  VII 

Coefficient  Alphas  for  OC  Factors 


Factor 

Coefficient  Aloha 

Immediate  Work  Group  (FI) 

0.85 

Employee/Supervisor  Interaction  (F2) 

0.84 

Organizational  Warmth  (F3) 

0.69 

Organizational  Communication  (F4) 

0.81 

Supervisory  Support  (F5) 

0.78 

The  coefficient  alphas  shown  in  Table  VII  are  quite 
high  indicating  good  reliability  for  the  scale  score  approach 
to  the  five  OC  factors.  These  results  in  addition  to  the 
analysis  of  the  loadings  lead  to  the  decision  to  use  scale 
scores  for  the  five  OC  factors  in  the  analysis  of  AFFDL  or¬ 
ganizational  change.  The  scale  scores  were  formed  as  linear 
combinations  of  the  variables  comprising  a  factor  with  equal 
weighting  on  each  variable.  The  equations  are  shown  below*. 

FI  =  Q22  +  Q26  +  Q28  +  Q31  +  Q32  +  Q33  +  Q35  +  Q38  +  Q39 
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F2  =  Q18  +  Q19  +  Q21  +  Q25  +  Q29  +  Q30  +  Q43 

F3  =  Q20  +  Q23  +  Q29  +  Q33  +  Q34  +  Q36  +  Q4l  +  Q44 

f4  =  Ql6  +  Q4l  +  q42  +  q45 

F5  =  Q24  +  Q37  +  Q40  +  Q43 

The  above  formulas  yield  scale  scores  which  can  vary 
as  shown  below: 

FI:  9  to  45 
F2 :  7  to  35 
F3:  8  to  40 
F4:  4  to  20 
F5:  4  to  20 

PC  Factor  Item  Intercorrelation.  To  obtain  an  in¬ 
dication  of  construct  validity,  the  zero-order  correlations 
among  factor  items  were  examined  via  Pearson  Produce  Moment 
Correlations  (Nie  et  al.,  1975)-  The  results  for  each  of 
the  five  factors  are  contained  in  Appendix  C.  As  would  be 
expected  the  intercorrelations  among  items  comprising  each 
factor  are  reasonably  high  verifying,  to  a  limited  degree, 
the  validity  of  the  construct. 

Productivity  Factor  Analysis.  As  described  under 
the  section  on  the  questionnaire,  Questions  51  through  58 
provide  data  on  an  individual  3&E's  productivity.  These 
questions  which  asked  for  each  S&E  to  indicate  how  many  of 
each  output  an  individual  either  authored  or  took  part  in 
over  the  past  year  are  listed  in  Table  VIII. 
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Table  VIII 

Productivity  Categories 


Question 

Output 

51 

Published  papers  in  profes¬ 
sional  or  technical  journals 

52 

Technical  Reports 

53 

Technical  memorandums  or 
test  data  reports 

54 

Presentations  at  symposia, 
meetings  of  professional  or¬ 
ganizations,  and  technical 
conferences 

55 

Hardware/software  specifica¬ 
tions,  statements  of  work, 
requests  for  proposals 

56 

In-house  studies,  technical 
and/or  managerial  assess¬ 
ments 

57 

Presentations  to  general  of¬ 
ficer-level  audiences 

58 

Professional  or  technical 
committee  participation 
(external  to  laboratory) 

The  above  questions  were  developed  after  a  discussion  with 
Mr.  Max  Davis  of  AFFDL  and  a  review  of  laboratory  products. 

Productivity  Dimensionality .  Dekok's  (1979)  PA1 
factor  analysis  of  the  combined  (1978,  79)  sample  yielded 
three  factors  with  eigenvalues  greater  than  1.0,  accounting 
for  60.1  percent  of  the  variance  (Dekok,  1979:76).  One  var¬ 
iable  exhibited  a  complexity  greater  than  one.  Q  58  loaded 
nearly  equally  on  Factor  One  and  Factor  Two  causing  some 
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factor  interpretation  problems.  All  factor  loadings  were 
higher  than  0.75  with  the  exception  of  Q  58  (0.52,  0.51 
respectively)  and  Q  55  (0.53)* 

A  PA1  factor  analysis,  using  Varimax  orthogonal 
rotation  with  Kaiser  normalization,  was  accomplished  using 
the  combined  (1978,  79 »  80)  data  sample  to  investigate  the 
productivity  factor  structure.  The  initial  analysis  yielded 
three  factors  with  eigenvalues  greater  than  1.0,  accounting 
for  57.2  percent  of  the  variance.  The  analysis  also  yielded 
some  confusion.  Q  58  again  loaded  on  both  Factor  One  and 
Factor  Two.  Q  55  switched  from  Factor  One  to  Factor  Three. 
Neither  Q  58  nor  Q  55  loaded  as  strongly  on  any  factor  as 
did  the  other  questions.  Following  discussions  with  other 
Air  Force  Institute  of  Technology  (AFIT)  researchers,  it  was 
decided  to  conduct  another  PA1  analysis  eliminating  Q5 5  and 
2  58  from  consideration  to  see  if  a  cleaner  factor  structure 
could  be  obtained. 

The  second  PA1  analysis  yielded  three  factors  with 
eigenvalues  greater  than  1.0,  accounting  for  68.6  percent  of 
the  variance.  Table  IX  contains  the  resultant  factor  struc¬ 
ture  from  the  second  PA1  analysis  of  the  combined  (1978,  79, 
80)  sample. 

The  factor  titles  used  for  the  productivity  factors 
were  suggested  by  Dekok  (1979)  and  are  retained  for  use  in 
this  analysis.  The  factor  structure  in  Table  IX  is  extreme¬ 
ly  "clean",  that  is,  no  variables  exhibit  complexities 
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Table  IX 

Productivity  Factor  Analysis  - 
Combined  Data  (N  =  685) 


1 


Factor  One 

Factor  Two 

Factor  Three 

Question 

External  Profes- 

Technical 

Management 

sional  Development 

Data 

Studies 

51 

0.87 

tH 

O 

O 

1 

-0.08 

52 

0.17 

0.77 

0.11 

53 

0.03 

0.83 

-0.01 

54 

0.80 

0.23 

0.09 

56 

-0.08 

0.16 

0.77 

57 

0.08 

-0.06 

0.82 

Eigenvalue 

1.77 

1.31 

1.04 

Percent  Variance 

Explained 

29.5 

21.9 

17.2 

greater  than  one.  The  variables  which  do  load  at  greater 
than  0.4  on  a  factor,  as  underlined  in  the  Table,  have  quite 
high  loadings  with  0.77  as  the  lowest  loading  obtained.  The 
factor  structure  and  loadings  obtained  in  the  second  PA1 
analysis  shown  in  Table  IX  is  a  significant  improvement  over 
the  previous  analysis. 

Factor  Scores  versus  Scale  Scores.  As  with  the  0C 
analysis  a  decision  had  to  be  made  concerning  the  use  of  Fac¬ 
tor  Scores,  via  SPSS  FACSCORE,  or  Scale  Scores  via  an  equal 
weighting  scheme  of  the  variables  compressing  each  factor. 

A  scale  score  would  be  far  easier  to  attach  meaning  to  than 
a  factor  score.  The  same  two  step  process  used  in  deciding 
the  0C  factor  question  as  to  scale  versus  factor  scores  was 
used  here. 


An  examination  of  the  loadings  in  Table  IX  shows  that 


all  the  loadings  were  quite  high,  0.77  to  0.87,  and  the 
"spread"  between  high  and  low  loadings  was  small  (for  those 
loadings  greater  than  0.4  as  underlined).  This  result  would 
support  an  equal  weighting  of  the  variables  in  a  linear 
combination  for  each  factor. 

The  second  step  was  to  calculate  coefficient  alpha 
for  each  productivity  factor  (Nunnally,  1967*.  196).  The  re¬ 
sults  are  shown  in  Table  X  for  each  productivity  factor. 


Table  X 

Coefficient  Alphas  for  Productivity  Factors 


Factors 

Coefficient  Alpha 

External  Professional 
Development  (Pi) 

0.55 

Technical  Data  (P2) 

0.50 

Management  Studies  (P3) 

0.48 

The  coefficient  alphas  shown  in  Table  X  are  not  as  good  as 
those  obtained  in  the  0C  factor  calculations.  The  coeffi¬ 
cient  alphas  obtained  for  the  productivity  factors,  however, 
are  considered  adequate  for  this  research.  As  Nunnally 
stated: 


In  the  early  stages  of  research  on  predictor 
tests  or  hypothesized  measures  of  a  construct, 
one  saves  time  and  energy  by  working  with  instru¬ 
ments  that  have  only  modest  reliability,  for 
which  purpose  reliabilities  of  .60  or  .50  will 
suffice  ....  For  basic  research,  it  can  be 
argued  that  increasing  reliabilities  beyond  .80 
is  often  wasteful  [Nunnally,  1967:226]. 
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In  view  of  the  above  information  and  the  strong  and 
nearly  equal  in  magnitude  loadings  obtained  for  variables 
comprising  a  productivity  factor,  it  was  decided  to  use 
scale  scores  for  the  productivity  factors  in  the  analysis  of 
organizational  change  at  AFFDL.  The  scale  scores  were  formed 
as  linear  combinations  of  the  variables  comprising  a  factor 
with  equal  weighting  on  each  variable.  The  equations  are 
shown  below: 

PI  =  Q51  +  Q5^ 

P2  =  Q52  +  Q53 
P3  =  Q56  +  Q57 

The  range  of  values  which  the  productivity  scale  scores  can 
yield  depends  upon  the  number  of  reports,  briefings,  etc., 
accomplished  by  an  individual  respondent. 

Productivity  Factor  Item  Intercorrelation.  As 
stated  by  Dekok, 

Unlike  organizational  climate,  there  is  no  basis 
for  assuming  that  productivity  levels  of  an  R&D 
organization  are  relatively  stable,  so  a  comparison 
of  the  stability  of  the  factor  structure  between 
each  year's  measurement  was  not  made  [Dekok,  1979: 

77]. 

The  interc orr elation  of  items  comprising  a  factor  were  ex¬ 
amined  to  obtain  an  indication  of  construct  validity.  The 
results  of  the  Pearson  Product  Moment  Correlation  Analysis 
(Nie  et.  al.,  1975)  are  contained  in  Appendix  D.  The  inter¬ 
correlations  among  items  comprising  a  factor  are  fairly 
high  and  consistent  verifying,  to  a  limited  degree,  the  va¬ 
lidity  of  the  construct. 


Absenteeism  Data.  Absenteeism  was  the  final  measure 
and  was  not  part  of  the  survey.  The  data  were  obtained  from 
the  AFFDL  manhour  accounting  system  which  categorizes  ab¬ 
sences  from  work  into  annual  leave,  sick  leave,  adminis¬ 
trative  "other  leave",  and  military -related  duties  (for  mil¬ 
itary).  The  data  on  sick  leave  were  utilized  to  construct 
this  measure  because  sick  leave  corresponds  the  closest  to 
absenteeism  in  the  private  sector.  The  measure  was  con¬ 
structed  by  dividing  a  division's  total  monthly  hours  charged 
to  sick  leave  by  the  total  manhours  available  for  the  month 
(Dekok,  1979! 78).  A  four  month  period,  October  through  Jan¬ 
uary,  was  used  for  each  year's  (1978,  79 »  8o)  sample.  The 
validity  of  the  absenteeism  measure  is  inherent  in  the  re¬ 
cords  system. 

Research  Methodology 

The  analysis  of  the  effect  of  the  team  development 
program  on  AFFDL  proceeded  according  to  the  data  analysis 
flow  shown  in  Figure  3*  The  first  step  was  to  examine  and 
confirm  the  integrity  of  the  1978  and  1979  data  samples. 

Next,  the  1980  data  sample  was  examined  and  edited  for  bad 
data  via  the  SPSS  routine  FREQUENCIES.  The  eleven  criterion 
measures  were  then  formed  via  the  formulas  and  procedures 
described  previously  in  this  chapter. 

Survey  Item  and  Criterion  Measure  Differences.  Once 
the  criterion  measures  were  formed,  the  next  analytic  step 
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Figure  3-  Data  Analysis  Flow 


was  the  examination  of  univariate  differences  in  overall 
laboratory  responses  to  the  58  questions  in  the  survey  in¬ 
strument  between  the  1978  and  1980  measurements.  The  cri¬ 
terion  measures  were  then  examined  for  division  differences, 
using  one-way  Analysis  of  Variance  (ANOVA),  in  each  year's 
sample.  Longitudinal  differences  in  criterion  scores  for 
each  division  were  computed  for  FE,  FX,  and  FB  for  the  two 
year  time  period  (1978  -  1980)  and  computed  for  FG  for  the 
one  year  time  period  (1979  -  1980).  As  was  previously  men¬ 
tioned,  no  measurement  was  made  of  FG  in  1978  so  a  longi¬ 
tudinal  calculation  for  1978  to  1980  could  not  be  made,  but 
could  be  calculated  for  1979  to  1980.  The  computed  differ¬ 
ences  were  tested  at  the  p  =  .05  level  (two  tailed  test). 

Differences  by  Divisions  Hierarchical  Groups.  Longi - 
tudinal  differences  in  criterion  scores  for  the  hierarchical 
groups,  defined  by  Question  7,  were  selected  for  analysis  for 
two  reasons  stated  by  Dekok, 

1.  Hierarchical  groups  have  more  intuitive 
appeal  as  subjects  for  analysis,  particularly  when 
results  are  communicated  back  to  the  organization. 

2.  The  effect  of  the  intensity  of  the  team 
building  intervention  could  be  tested,  at  least 
indirectly,  with  hierarchical  groups  [Dekok,  1979; 

83]. 

A  one-way  ANOVA  was  used,  with  division  membership 
controlled,  in  each  year's  sample  to  obtain  the  means  for 
each  factor.  The  longitudinal  test  of  the  differences  was 
calculated  based  on  the  two  year  period  from  the  1978  meas¬ 
urement  to  the  1980  measurement. 
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Factor  Trends.  As  a  final  graphic  examination  of 
the  effects  of  the  OD  program  on  AFFDL,  the  values  for  the 
criterion  measures  are  plotted,  hy  division,  for  each  of  the 
three  measurements.  While  three  data  points  are  not  suffi¬ 
cient  for  a  good  solid  trend  indication,  the  plots  provide  a 
graphic  view  of  the  process  being  measured. 

Summary 

The  research  design  and  methodology  presented  in  this 
chapter  were  designed  to  answer  the  questions  and  hypotheses 
stated  in  Chapter  I.  The  basic  question  was:  Has  the  team 
building  organizational  development  (OD)  intervention  at 
the  Air  Force  Flight  Dynamics  Laboratory  (AFFDL)  had  any 
measurable  effect  on  the  various  organizational  goals  that 
were  stated  for  the  program? 

The  main  thrust  of  this  analysis  was  the  longitudinal 
differences  in  the  eleven  criterion  measures  exhibited  by  the 
four  main  product  divisions  of  AFFDL.  The  voluntary  nature 
of  the  AFFDL  OD  program  provided  a  natural  experimental  set¬ 
up  with  two  divisions  (FE  and  FG)  participating  in  the  OD 
program  and  the  other  two  divisions  (FX  and  FB)  not  partic¬ 
ipating. 

With  the  exception  of  the  absenteeism  measure,  the 
other  measures,  job  satisfaction,  job  motivation,  five  meas¬ 
ures  of  organizational  climate,  and  three  measures  of  pro¬ 
ductivity  (S&E’s)  were  formed  as  scale  scores  using  a 
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linear  combination  of  the  equally  weighted  variables  com¬ 
prising  each  measure.  The  examination  of  the  longitudinal 
changes  in  the  criterion  variables  exhibited  by  the  treat¬ 
ment  groups  (FE  and  FG)  and  control  groups  (FX  and  FB)  al¬ 
lowed  an  assessment  of  the  effectiveness  of  the  team  building 
intervention  at  AFFDL. 


Ill  Results  and  Discussion 


Introduction 

The  presentation  of  the  analysis  results  in  this 
chapter  follows  the  data  analysis  flow  diagram  provided  in 
Chapter  II,  Figure  3*  Following  the  numerical  results  of 
each  section  of  the  analysis  is  a  brief  discussion  relating 
these  results  to  the  AFFDL  OD  program  and  other  facets  of 
the  AFFDL  organization. 

Examination  of  the  Data 

The  first  step  in  the  analysis  of  the  AFFDL  data  was 
to  examine  the  overall  change  in  laboratory  responses  to  the 
58  items  in  the  survey  instrument  from  19?8  to  1980.  Dekok, 
in  his  analysis  of  the  overall  change  from  1978  to  1979 » 
found  remarkable  stability  in  the  data  with  only  three  items 
exhibiting  statistically  significant  changes.  Those  items 
included  one  organizational  climate  (positive  change),  one 
productivity  (negative  change)  and  one  nature  of  work  item 
(negative  change).  The  same  stability  observed  by  Dekok  for 
the  one  year  period  (1978-1979)  is  evident  in  the  results 
shown  in  Table  XI  for  the  two  year  (1978-1980)  period.  As 
depicted  in  Table  XI,  three  items  changed  significantly  from 
1978  to  1980.  Q3,  Years  in  Division,  is  an  expected  demo¬ 

graphic  consequence  of  a  longitudinal  study.  Ql6,  Infos 


Table  XI 

Survey  Item  Comparison* 
(1978,  1980) 


Mean/Std  Deviation 

Question 

Short  Name 

1978 

1980 

1 

Age 

4.46/2.10 

4.53/2.08 

2 

Grade 

3.82/1.51 

3.88/1.50 

3** 

Years  in  Division 

5-39/2.00 

6.02/1 .49 

4 

Years  in  Lab 

3.40/1.72 

3.61/1.62 

5 

Education  Level 

4.78/1.81 

4.90/1.65 

6 

Division 

a 

a 

7 

Position 

3-04/1.19 

2.98/1.09 

8 

Hoppock-1 

4.71/1.37 

4.70/1.24 

9 

Hoppock-2 

4.88/1 .04 

4.91/  -95 

10 

Hoppock-3 

4.66/1.07 

4.16/1.04 

11 

Hoppock-4 

4.51/  .94 

4.47/  .84 

12 

Patchen-1 

3.94/1.28 

3.82/1.30 

13 

Patch en- 2 

3.23/  .82 

3-14/  .81 

14 

Patchen-3 

3.36/1.31 

3 . 24/1 . 30 

15 

Patchen-4 

3.69/  .85 

3.70/  .82 

16*** 

Info:  Group 

3.03/1.29 

3.22/1.26 

17 

Objectives 

3.81/  .89 

3.84/  .87 

18 

Credit  for  Work 

3 . 36/1 . 24 

3.51/1.19 

19 

Supv  Pays  Attn 

3-71/  -95 

3.66/  .98 

20 

Organ ' 1  Loyal ty 

3.13/1.17 

3.12/1.19 

21 

Autonomy 

4.14/  .99 

4.05/1.12 

22 

Group  Friendly 

4.19/1.02 

4.17/  .93 

23 

Promot  Sys  Effectv 

2.28/1.14 

2.37/1.16 

24 

Supv  Hi  Standards 

3.59/  .95 

3.59/  .99 

25 

Supv  Esteem 

3.20/  .97 

3.33/  -95 

26 

Group  Help 

2.87/1.08 

2.80/1.08 

27 

Know  What's  Exptd 

3.78/1.04 

3.75/1.06 

28 

Group  Plan 

3.10/1.08 

3.06/1.16 

*N, 

(1978)  =364  a  =  N/A  **p<  .01 

N2 

(1980)  =  342 

***p<  .05 
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Table  XI  (Cont'd)  # 


Mean/Std  Deviation  I 

Question 

Short  Name 

1978 

1180 

29 

Rewards  GT  Criticism 

3.24/1.26 

3-30/1.29 

30 

Supv  Friendly 

4.14/1.12 

4.07/1.09 

31 

Group  Pays  Attn 

3.71/  .77 

3.67/  .79 

32 

Group  Exchg  Ideas 

3.53/8.7 

3.41/  .88 

33 

Organizational  Pride 

3.66/1.03 

3.60/1 .03 

34 

Rewards 

2.74/1.14 

2.76/1.12 

35 

Group  Trust 

3.75/  .91 

3.71/  .84 

36 

Decisions 

2.65/1.11 

2.68/1.10 

37 

Supv  Encourage 

Best  Effort 

3 .49/  .98 

3-5-5/  .96 

38 

Group  Sharing 

3.70/  .92 

3-70/  .83 

39 

Influence  Decisions 

3.30/1.25 

3.40/1.26 

40 

Pressure  to  Improve 

2.88/1 .05 

2.90/1.08 

41 

Info  Sharing 

2.46/1.04 

2.50/1 .01 

42 

Info:  Branch 

3.17/1.18 

3-28/1.17 

43 

Supv  Encourages  Ideas 

3.31/  .99 

3-31/1.04 

44 

People  Asked  Ideas 

2.82/1.09 

2.84/1 .03 

45 

Info:  Division 

2.68/1.21 

2.83/1.14 

46 

R  &  D  (In-House) 

27.15/26.56 

28.77/25.68 

47 

Contract  Guidance 

18.50/20.74 

20.81/20.61 

48 

Technical  Support 

20.57/21 .99 

17.75/19.5^ 

49 

Program  Admin. 

23.55/20.05 

22.94/18.44 

50 

Supervision 

9.03/1^.79 

9-17/14.85 

51 

Published  Papers 

. 3V  -72 

.41/  .8? 

52 

Technical  Reports 

.56/1.27 

.4o/  .76 

53 

Technical  Memos 

•  9V1.95 

.89/1 .82 

54 

Presentations 

.91/1.5-9 

•81/1.55 

55** 

Specifications 

2.55/3.73 

1.77/2.1 

56 

In-House  Studies 

2.06/3.61 

1 .82/2.79 

57 

Gen  Officer  Briefings 

1.38/2.84 

1.62/3.85 

58 

Committee  Parti c 

.89/1.77 

.98/1.99 

#  For 

Questions  46-58  N0  (1980)  =  234 

N1 

(1978)  =  206 

**p<  .01 

I 


Group,  is  the  same  climate  item  which  exhibited  significant 
change  in  Dekok 's  study.  From  1979  to  1980  Ql6,  Info:  Group, 
actually  declined  from  a  value  of  3-2?  in  1979  to  3.22  in 
1980.  Means  and  Standard  Deviations  for  the  1979  responses 
are  contained  in  Appendix  F.  The  final  item  which  changed 
significantly  was  Q55»  Specifications,  a  productivity  item. 
This  item  declined  from  1978  to  1980  (p  =  .01)  also. 

Discussion .  As  discussed  by  Dekok,  there  are  three 
basic  reasons  for  the  stability  illustrated  by  the  results  in 
Table  XI: 

1.  Organizational  climate  may  change  slowly  over 
time  as  individual  perceptions  alter.  This  may  be  particu¬ 
larly  true  if  the  humanistic  process  type  changes  are  not 
backed  up  or  coupled  with  structural  changes.  As  stated  by 
Woodman,  organizational  climate  "...  has  an  air  of  perma¬ 
nency  or  at  least  some  continuity  over  time  [Woodman,  1978: 
818]."  Dekok  observed  that  one  year,  1978  to  1979»  may  have 
been  too  short  a  time  for  the  0D  changes  to  manifest  them¬ 
selves.  With  a  two  year  period  more  change  might  have  been 
expected  in  the  climate  questions  or  the  productivity  re¬ 
sponses  unless  either  0D  is  not  having  any  effect  or  one  of 
the  following  reasons  is  the  case. 

2.  The  0D  program  at  AFFDL  has  been  underway  since 
1976.  It  is  possible  that  most  of  the  change  resulting  from 
the  team  building  intervention  occurred  prior  to  the  begin¬ 
ning  of  the  measurement  process  in  late  1977*  If  Likert's 


model  of  organizational  change,  discussed  in  Chapter  I,  is 
accurate  the  AFFDL  process  would  he  at  the  end  of  the  chain 
of  events  and  further  changes  in  the  perceptual  variables 
(Q16-Q45)  would  not  be  expected.  Changes  in  end  result  var¬ 
iables,  i.e.  productivity,  would  be  expected  but  it  is  pos¬ 
sible  that  some  divisions  went  up  while  others  went  down 
thereby  negating  the  change  over  timet  Reason  three  addresses 
this  issue. 

3.  It  is  possible  that  between  the  time  of  the  first 
measurement  (1978)  and  the  last  measurement  (1980)  that  the 
treatment  divisions  ( FE  and  FG)  gained  on  some  variables 
while  the  control  divisions  (FX  and  FB)  declined  on  those 
variables  and,  therefore,  negated  any  change  for  the  labora¬ 
tory  as  a  whole  (Dekok,  1979:87-88). 

In  view  of  the  above  alternatives  for  the  stability 
in  the  AFFDL  data,  it  is  not  possible  to  draw  any  firm  con¬ 
clusions  concerning  the  effectiveness  of  the  AFFDL  OD  pro¬ 
gram.  Divisional  differences  must  be  examined  to  see  if  the 
OD  program  succeeded  in  providing  statistically  significant 
separation  between  OD  and  non-OD  divisions. 

Analysis  of  Division  Differences 

The  next  step  in  the  analytic  process  was  to  examine 
the  scores  of  the  divisions  for  the  various  criterion  meas¬ 
ures  developed  in  Chapter  II.  First  divisional  differences 
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were  examined  within  each  year  (1978,  1979»  1980)  and  finally 
a  longitudinal  analysis  was  conducted  on  the  scores  from  1978 
to  1980. 

Tests  of  Differences  Among  Divisions  (ANOVA).  The 
SPSS  procedure  BREAKDOWN  (Nie  et  al . ,  1975)  was  utilized  to 
generate  means  and  standard  deviations  for  each  of  the  cri¬ 
terion  measures  by  division  and  to  perform  one-way  analyses 
of  variance  (ANOVA)  on  the  data.  The  results  of  those  anal¬ 
yses  are  shown  in  Tables  XII  (1978),  XIII  (1979)*  and  XIV 
(1980).  Note  that  FG  was  not  part  of  the  1978  measurement 
and  therefore  not  contained  in  Table  XII  (1978). 

The  results  from  Table  XII  (1978)  show  that  little 
statistical  difference  exists  among  the  three  divisions. 

Only  one  of  the  ten  criterion  measures  indicated  that  a 
statistical  (p  =  .05)  difference  existed  between  the  divi¬ 
sions.  Climate  Factor  Five,  Supervisory  Support,  indicated 
a  difference  at  the  p  =  .03  level.  This  was  due  to  a  high 
value  for  FE  (OD  treatment  division)  and  a  low  value  for  FB 
(control  division).  The  ANOVA  result  does  lend  some  support 
to  alternative  one  discussed  in  the  previous  section  and 
denied  alternatives  two  and  three.  If  all  or  most  of  the  OD 
induced  change  had  occurred  prior  to  1978  (first  measurement) 
then  the  ANOVA  for  1978  should  have  revealed  more  statisti¬ 
cally  significant  differences  in  Organizational  Climate  (OC) 
and  productivity  measures.  Along  the  same  lines  if  FE  and 
FG  (treatment)  divisions  had  gained  on  measures  while  FX  and 
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Measure 

Short  Name 

Means 

FX 

and  ( S . 
FB 

rr - 

FE 

F 

/alue 

Hoppock 

Job  Satisfaction 

18.62 

(3-86) 

19-09 

(3-45) 

18.55 

(3-90) 

.58 

Patchen 

Job  Motivation 

14.22 

(3-01) 

13-90 

(3-41) 

14.62 

(3-33) 

•  95 

Climate 
Factor  1 

Immediate  Work 
Group 

31.92 

(5-96) 

31.74 

(6.22) 

31-74 

(6.55) 

.27 

Climate 
Factor  2 

Smployee/Supv 

Interaction 

24.90 

(5-5) 

25-03 

(5-37) 

25.33 

(5-17) 

.13 

Climate 
Factor  3 

Organizational 

Warmth 

22.37 

(4.54) 

22.99 

(4.88) 

2301 

(5-40) 

.76 

Climate 
Factor  4 

Or gani z  ati onal 
Comm  uni  cati  on 

11.00 

(3-73) 

11.48 

(3-51) 

11.38 

(4.03) 

.60 

Climate 
Factor  5 

Supervisory 

Support 

13-17 

(3-28) 

12.85 

(2.91) 

14.05 

(2.85) 

3.25** 

Productvy 
Factor  1 

Ext  Professional 
Development 

•  95 
(1.36) 

1.36 

(2.11) 

1.41 

(2.05) 

1.13 

Productvy 
Factor  2 

Technical  Data 

1.02 

(1.39) 

1.77 

(3-98) 

1.63 

(2.17) 

1.31 

Productvy 
Factor  3 

Management 

Studies 

3-43 

(5-81) 

3.31 

(5-28) 

3.72 

(4.32) 

.10 

**P<«03 


#N's  for  all  measures  except 

Productivity  Factors  109  l4l  95 

N's  for  Productivity  Factors  6 5  86  54 


Table  XIII 

Differences  Among  Divisions 
on  Criterion  Scores  (1979)  # 


Measure 

Short  Name 

Means  and 
FX  FB 

(  S  .  D .  ) 

FE 

FG 

F 

Value 

Hoppock 

Job  Satisfaction 

18.98 

(3-23) 

19.00 

(3.63) 

18.99 

(3-62) 

19.06 

(3-57) 

.01 

Patchen 

Job  Motivation 

14. 06 
(3.01) 

14.19 

(3-22) 

14. ?6 
(2.99) 

14. 16 
(3-05) 

•  79 

Climate 
Factor  1 

Immediate  Work 
Group 

30.37 

(5-98) 

31-56 

(5.81) 

32.39 

(5-58) 

31.63 

(5-51) 

1 .49 

Climate 
Factor  2 

Employee/Supv 

Interaction 

25.06 

(5-20) 

25.56 

(5-30) 

25.43 

(5-23) 

26.24 

(4.83) 

.94 

Climate 
Factor  3 

Organi zational 
Warmth 

21.62 

(4.90) 

23.67 

(4.81) 

23.41 

(4.90) 

23.82 

(4.99) 

3.29* 

Climate 
Factor  4 

Organizational 

Communication 

10. 83^ 
(3-75) 

11.96 

(3-53) 

12.72 

(3.43) 

12.18 

(3.72) 

3-51* 

Climate 
Factor  5 

Supervisory 

Support 

13.30 

(3-10) 

13-24 

(3.18) 

14.13 

(2.79) 

13.73 

(2.72) 

1.62 

Productvy 
Factor  1 

Ext  Professional 
Development 

1.11 

(1.44) 

1.72 

(2.36) 

0.96 

(1.26) 

0.76 

(1-37) 

2.94** 

Productvy 
Factor  2 

Technical  Data 

1.06 

(1.25) 

2.02 

(2.69) 

1.02 

(1.10) 

0.47 
( -95) 

7.34*** 

Productvy 
Factor  3 

Management 

Studies 

2.14 

(2.57) 

3.24 

(7.97) 

3-18 

(4.07) 

(3-74) 

.60 

*p<  .01  **p<  .02  ***p  =  .0000 


#N's  for  all  measures  except  99  107  33  116 

Productivity  Factors 


N's  for  Productivity  Factors 
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58 


49 


72 


Table  XIV 

Differences  Among  Divisions 
on  Criterion  Scores  (1980)  # 


Measure 

Short  Name 

Means  and 
FX  FB 

( S  .  D . ) 
FE 

FG 

F 

Value 

Hoppock 

Job  Satisfaction 

18.83 

(3-23) 

18.36 

(3-78) 

18.6? 

(2.97) 

18.93 

(3-40) 

.53 

Patchen 

Job  Motivation 

14.02 

(3.03) 

13-78 

(3.20) 

13-82 

(3-19) 

13.92 

(2.96) 

.11 

Climate 
Factor  1 

Immediate  Work 
Group 

31.4  2 
(5-96) 

30.99 

(6.14) 

32.41 

(6.35) 

31-77 

(6.43) 

.71 

Climate 
Factor  2 

Employee/Supv 

Interaction 

24.85 

(5.28) 

24.65 

(6.01) 

25.65 

(5-13) 

26.13 

(5-72) 

1.36 

Climate 
Factor  3 

Organizational 

Warmth 

22.91 

(5-1?) 

22.?2 

(5-15) 

25-37 

(5-26) 

23.75 

(4.66) 

.86 

Climate 
Factor  4 

Organizational 

Communication 

11.40 

(3-4?) 

11.60 

(3.86) 

12.38 

(3.42) 

12.21 

(3-85) 

1.28 

Climate 
Factor  5 

Supervisory 

Support 

13-26 

(2.99) 

12.91 

(3-23) 

14.25 

(2.63) 

12.94 

(3-48) 

2.73* 

Productvy 
Factor  1 

Ext  Professional 
Development 

1.48 

(2.74) 

1.60 

(2.54) 

1.14 

(1.67) 

0.69 

(1.03) 

2.38 

Productvy 
Factor  2 

Technical  Data 

1.38 

(1.77) 

1.66 

(3.11) 

1.00 

(1.12) 

O.85 

(1.35) 

1-31 

Productvy 
Factor  3 

Management 

Studies 

2.72 

(3.48) 

3.44 

(6.60) 

4.37 

(5-52) 

3.49 

(3-63) 

.95 

*p  <  .05 

#N's  for  all  measures  except 
Productivity  Factors 

89 

106 

60 

87 

N's  for 

Productivity  Factors 

6l 

62 

43 

68 

66 


FB  (control)  divisions  declined  then  the  1978  ANOVA  should 
have  revealed  more  separation.  At  this  point  in  the  anal¬ 
ysis,  the  lack  of  a  pre-OD  baseline  makes  it  difficult  to 
state  conclusions  with  any  firmness.  The  OD  process  may  be 
changing  the  AFFDL  treatment  divisions  so  slowly  that  as  of 
1978  no  real  effect  had  been  observed. 

The  1979  ANOVA  results  revealed  more  statistically 
significant  differences  among  the  divisions.  Four  criterion 
measures  exhibited  significant  differences:  two  OC  and  two 
productivity.  Dekok  offered  two  reasons  for  the  increased 
separation  of  the  divisions  in  1979: 

1.  Division  FG's  inclusion  in  the  data  for  the 
first  time  induced  sufficient  changes  in  the  ANOVA  to  ac¬ 
count  for  the  increased  number  of  significant  differences. 

2.  The  divisions  exhibited  different  rates  of  change 
from  1978  to  1979  in  the  measures  (Dekok,  1979:92). 

Dekok' s  analysis  showed  that  FG's  inclusion  was  not 
responsible  for  the  change  in  the  1979  ANOVA.  Reason  Two  was 
examined  via  the  longitudinal  analysis  technique,  which  is 
discussed  in  this  chapter. 

If  the  AFFDL  OD  program  was  having  any  effect,  however 
slowly,  one  would  have  expected  to  see  increased  positive 
significant  differences  in  the  1979  ANOVA  from  the  1978  ANOVA. 
The  results  for  Climate  Factors  Three  and  Four,  Organiza¬ 
tional  Warmth  and  Communication  respectfully,  are  due  to  FE 
and  FG  having  relatively  high  scores  compared  to  FX's 
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relatively  low  score.  This  was  in  the  direction  expected, 
if  OD  worked,  since  FE  and  FG  are  treatment  divisions.  The 
productivity  results  are  disturbing,  however,  since  the  sig¬ 
nificant  differences  were  due  to  low  values  for  FE  and  FG 
(treatment)  and  higher  values  for  FX  and  FB  (control).  This 
is  basically  opposite  to  what  would  be  expected  if  OD  was 
having  a  positive  effect.  At  this  point  the  OD  program  at 
AFFDL  had  been  underway  for  over  three  years.  Forras  and 
Berg  (1978)  indicated  that  involvement  by  an  OD  consultant 
for  13-24  months  tends  to  produce  the  best  results.  Either 
the  AFFDL  OD  process  is  very  slow  or  OD  is  not  meeting  with 
full  success  since,  as  stated  before,  the  only  basic  reason 
for  organizational  change  is  to  improve  effectiveness/pro¬ 
ductivity.  The  above  paradox  of  results  could  only  be  an¬ 
swered  by  the  third,  1980,  measurement  and  ANOVA. 

The  1980  ANOVA  results  in  Table  XIV  showed  that  with 
only  one  exception  the  four  divisions  were  not  statistically 
separable  on  the  ten  criterion  measures.  Only  Climate  Factor 
Five,  Supervisory  Support,  statistically  separated  the  divi¬ 
sions  (p  =  .05) •  This  was  due  to  a  relatively  high  value 
for  FE  (treatment)  and  a  low  value  for  FB  (control)  in  rela¬ 
tion  to  FE.  The  differences  seen  in  1979  on  Climate  Factors 
Three  and  Four  evaporated  in  1980  as  the  divisions  moved 
closer  together.  Even  OC  Factor  Five  was  barely  significant 
at  p  =  .05  when  in  1978  it  was  significant  at  p  =  .03.  In 
terms  of  productivity  the  treatment  divisions  (FE  and  FG) 
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made  modest  gains  from  1979  on  several  measures  but  FX 
and  FB  (control)  made  larger  gains,  generally. 

At  the  time  of  the  1980  measurement  the  OD  program 
at  AFFDL  had  been  underway  for  over  four  years.  If  it  had 
been  effective,  there  should  have  been  more  significant  dif¬ 
ferences  between  the  treatment  and  control  divisions.  The 
1980  ANOVA's  revealed  little,  if  any,  significant  differences 
among  the  four  divisions  at  a  point  where  one  would  have  ex¬ 
pected  to  see  differences  if  OD  was  having  a  positive  effect. 

Tests  of  Longitudinal  Change.  The  next  step  in  the 
analysis  was  to  examine  the  rate  of  changes  in  criterion 
scores  from  1978  to  1980  for  divisions  FX,  FB,  and  FE.  In 
Dekok's  analysis  of  the  change  from  1978  to  1979  only  two 
criterion  measures  exhibited  significant  change  using  the 
two  tailed  t-test  (p  =  .05).  Climate  Factor  One,  Immediate 
Work  Group,  showed  a  significant  (p  =  .03)  decrease  in  FX 
(control).  Climate  Factor  Four,  Organizational  Communica¬ 
tion,  showed  a  significant  (p  =  .01)  increase  for  FE  (treat¬ 
ment).  In  terms  of  the  FE  increase  on  communication  ( 1978— 
1979) »  Dekok  stated: 

In  the  absence  of  any  evidence  supporting 
another  causal  agent,  it  is  difficult  to  reach 
any  conclusion  other  than  the  OD  program  was  re¬ 
sponsible  for  this  change  [Dekok,  1979:96]. 

The  results  of  the  1978  to  1980  longitudinal  analy¬ 
sis  are  provided  in  Table  XV.  None  of  the  differences  shown 
in  that  Table  are  statistically  significant.  Organizational 
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Table  XV 

Divisional  Change  (Longitudinal) 
on  Criterion  Measures  #* 


Measure 

Short  Name 

Means 

FX 

;  1980  -  1978 
( t-value ) 

FB  FE 

Hoppock 

Job  Satisfaction 

.21 

(.41) 

-•73 
(  -4l) 

.12 

(  .20) 

Patchen 

Job  Motivation 

-.20 

(-.47) 

-.12 

(-.28) 

-.80 

(-1.48) 

Climate 
Factor  1 

Immediate  Work 
Group 

-.50 

(-.59) 

-.75 

(-.94) 

.67 

(.63) 

Climate 
Factor  2 

Employee/Supv 

Interaction 

-.05 

(-.06) 

-.38 

(-.56) 

.32 

(.38) 

Climate 
Factor  3 

Organizational 

Warmth 

.  54 
(.78) 

-.27 

(-.42) 

.26 
( .29) 

Climate 
Factor  4 

Organi zati onal 
Communication 

.40 
( .77) 

.12 
(  .20) 

1.00 

(1.59) 

Climate 
Factor  5 

Supervisory 

Support 

.09 
( .20) 

.06 
(  .12) 

.20 

(.44) 

Productvy 
Factor  1 

Ext  Professional 
Development 

•  53 
(1.39) 

.24 

(.62) 

-.27 

(-.70) 

Productvy 
Factor  2 

Technical  Data 

.36 

(1.28) 

-.11 

(-.18) 

-.63 

(-1.73) 

Productvy 
Factor  3 

Management 

Studies 

-.71 

(-.83) 

•  13 
( .13) 

.65 

(.65) 

*  None  of 

these  differences  i 

ire  statistically  significant 

#  Numbers  are  rounded  to  two 
in  this  and  similar  tables 
1978  mean  scores. 

decimal  places;  Values  shown 
are  1980  mean  scores  minus 

| 

Communication,  Climate  Factor  Four,  declined  from  1979 
(12.72)  to  1980  (12.38)  for  FE,  which  accounted  for  its  loss 
of  significance.  Also  disturbing,  in  terms  of  OD  effective¬ 
ness,  were  the  results  of  the  productivity  tests.  For  FE 
(treatment)  two  out  of  three  measures  continued  to  exhibit 
negative  trends.  Although  they  failed  to  reach  statistical 
significance.  The  remaining  productivity  factor,  Management 
Studies,  made  a  modest  gain  from  1978  to  1980.  The  situation 
was  reversed  for  the  Control  (FX  and  FB)  divisions  where  two 
out  of  three  productivity  factors  exhibited  modest  positive 
changes  while  the  third  had  a  negative  change. 

Discussion.  The  results  of  the  ANOVAs  and  longitu¬ 
dinal  analysis  presented  in  the  previous  section,  coupled 
with  the  fact  that  FG  exhibited  no  significant  changes  on 
its  criterion  scores  from  1979  to  1980,  supported  the  con¬ 
clusion  that  if  OD  had  any  effect  it  was  temporary  and  had 
largely  disappeared  by  the  time  of  the  1980  measurement.  The 
AFFDL  OD  program  was  apparently  responsible  for  the  tempo¬ 
rary  significant  gain  by  FE  on  the  quality  of  communication 
within  that  division  from  1978  to  1979>  which  led  to  the  sig¬ 
nificance  of  the  ANOVA  for  1979-  This  conclusion  was  reached 
due  to  a  lack  of  any  other  plausible  reason  for  such  a  sig¬ 
nificant  gain  by  FE.  In  addition  both  FE  and  FG  had  con¬ 
sistently  higher  scores  in  1979  and  1980  for  the  communica¬ 
tion  factor  than  FX  or  FB,  even  though  this  difference  was 
not  statistically  significant.  The  downturn  in  FE's 
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communication  factor  score  from  1979  to  1980  coupled  with 
modest  gains  by  both  FX  and  FB  led  to  the  divisions  becoming 
statistically  inseparable  on  the  quality  of  communication 
factor  in  1980.  Even  more  to  the  point  concerning  AFFDL's 
team  building  technique  of  intervention,  the  lack  of  statis¬ 
tically  significant  positive  change  for  Climate  Factor  One, 
Immediate  Work  Group,  from  1978  to  1980  raised  some  serious 
problems.  As  stated  by  Dekok: 

Since  team  building  has  as  its  focus  the  crea¬ 
tion  of  a  supportive,-  cohesive  work  group,  the  lack 
of  significant  results  indicated  by  the  data  casts 
some  doubt  on  the  efficacy  of  this  OD  intervention 
[Dekok,  1979:96]. 

Divisional  Differences  by 
Hierarchical  Groups 

As  previously  stated  in  Chapter  II,  there  were  two 
reasons  for  examining  the  hierarchical  groups  (secretaries, 
technicians,  etc.)  in  terms  of  the  criterion  measures. 

First,  there  was  an  intuitive  appeal  to  using  the  natural 
groups  for  analysis  and  in  communicating  results  to  AFFDL. 
Second,  the  use  of  those  groups  allowed  a  look  at  the  effects 
of  the  intensity  of  the  OD  intervention.  The  Hoppock, 
Patchen,  and  five  OC  factors  were  used  in  this  analysis.  The 
productivity  factors  were  not  used  in  this  analysis.  The 
productivity  factors  were  not  used  because  the  previous  anal¬ 
ysis  essentially  measured  productivity  in  one  group:  S&E's. 
Group  Leaders  and  Branch  Chiefs  are  S&E's  in  management  posi¬ 
tions  . 
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Job  Satisfaction.  The  ANOVA  results  for  the  Hoppock 
measure  are  contained  in  Table  E-l  (19?8),  Table  E-8  (1979)* 
and  Table  E-15  (1980)  in  Appendix  E.  With  the  exception  of 
S&E's  in  1978  and  Branch  Chiefs  in  1979*  none  of  the  other 
natural  groups  exhibited  statistical  differences  for  job  sat¬ 
isfaction.  In  both  cases  FB  (control)  had  the  high  scores. 

The  longitudinal  results  shown  in  Table  XVI  contain 
no  statistically  significant  results  for  the  two  year  period 
1978  to  1980  at  the  p  =  .05  level. 


Table  XVI 

Longitudinal  Change  for  Hierarchical  Groups: 
Job  Satisfaction  (Hoppock)  # 


Means:  1980  -  1978 
( t-value) 

Grout)  Name  FX  FB  ,  FE 


“ “ — 

1 

”  ” 

1 

Secretaries 

0.25 

(.18) 

-1.26 

(-.88) 

1 .63 

(  .74) 

2 

Technicians 

-0.14 

(-.12) 

-1.12 

(-.77 

-0.84 

(.52) 

3 

S&E's 

: 

0.07 
( .01) 

-0.53 

(-.98) 

0.73 
( -93) 

4 

Group  Leaders 

-0.76 

(-.52) 

-O.56 

(-.62) 

-0.78 

(-.51 

5 

Branch  Chiefs 

0.00 

(0) 

0.54 

(.17) 

1.33 

(1.29) 

#  None  of  the  above  differences  are  statistically  sig¬ 
nificant. 

Note:  N's  for  the  tests  in  this  section  on  Hierarchical 
groups  are  found  in  Appendix  E. 
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Discussion .  These  results  confirm  the  previous  di¬ 
vision  wide  analysis.  No  positive  effect  by  OD  on  job  sat¬ 
isfaction  can  be  seen  in  these  data.  Many  groups  across 
the  three  divisions  had  negative  trends,  including  Group 
Leaders  from  all  three  divisions  in  this  analysis.  This  was 
opposite  from  what  would  be  expected  since  Group  Leaders  had, 
along  with  Branch  Chiefs,  more  frequent  contact  with  the  OD 
program. 

Job  Motivation.  The  ANOVA  results  for  the  Patchen 
measure  are  contained  in  Table  E-2  (1978),  Table  E-9  (1979)» 
and  Table  E-l6  (1980)  in  Appendix  E.  None  of  the  results 
were  statistically  significant. 

The  longitudinal  results  shown  in  Table  XVII  like¬ 
wise  produced  no  significant  results  in  terms  of  differences 
from  1978  to  1980. 


Table  XVII 

Longitudinal  Change  for  Hierarchical  Groups: 
Job  Motivation  (Patchen)  # 


Means:  I98O  -  1978 
( t -value) 

Group 

Name 

FX 

FB 

FE 

1 

Secretaries 

0.25 
( .19) 

0.49 

(.40) 

0.07 

(.04) 

2 

Technicians 

-1.41 

(-1.44) 

-0.58 

(-.49) 

-1.06 

(-.75) 

3 

S&E's 

0.26 

(.46) 

0.23 

(.42) 

-0.97 

(-1.34) 

4 

Group  Leaders 

0.01 
( .01) 

-1 .04 
(-.68) 

-1.01 

(-1.19) 

5 

Branch  Chiefs 

0.00 

(0) 

-1.07 

(-.59) 

-1.09 

(-.94) 

#  None  of 
icant . 

the  above  differences  are 

statistically  signif- 
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Discussion .  These  results  indicated  that  the  team 
building  intervention  had  failed  to  provide  a  significant  ef¬ 
fect  on  job  motivation.  Dekok  discovered  a  negative  trend 
for  Branch  Chiefs  and  Group  Leaders  across  all  three  divi¬ 
sions  from  1978  to  1979*  The  1978  to  1980  analysis  con¬ 
firmed  this  trend  although  FX  appeared  to  have  arrested  their 
trend.  As  stated  by  Dekok, 

This  implies  that  the  intensity  of  the  inter¬ 
vention  does  not  have  a  positive  effect  on  organ¬ 
izational  change  for  this  factor.  This  is  con¬ 
trary  to  the  finding  of  Porras  and  Berg  (1978) 

[Dekok,  1979: 143]. 

Immediate  Work  Group.  The  ANOVA  results  for  FI  are 
contained  in  Table  E-3  (1978),  Table  2-10  (1979) »  and  Table 
2-17  (1980)  in  Appendix  E.  There  was  one  statistically  sig¬ 
nificant  result  in  each  year;  Branch  Chiefs  (1978),  S&E’s 
(1979),  and  Technicians  (1980).  None  of  the  ANOVA  results 
indicated  any  clearly  positive  OD  effect. 

The  longitudinal  results  contained  in  Table  XVIII 
showed  no  statistically  significant  results  for  the  two  year 
period . 

Discussion.  In  terms  of  the  team  building  inter¬ 
vention  utilized  at  AFFDL,  this  was  a  disappointing  result. 

As  stated  previously,  team  building  is  directed  at  the  work 
group;  the  failure  to  produce  any  clear  positive  improve¬ 
ment  has  reflected  problems  for  the  AFFDL  OD  program. 

Employee/Supervisor  Interaction.  The  ANOVA  results 
for  F2  are  contained  in  Table  E-4  (1978),  Table  2-11  (15~°), 
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Table  XVIII 

Longitudinal  Change  for  Hierarchical  Groups: 
Immediate  Work  Group  (FI)  # 

Means:  1980  -  1978 
( t-value) 


Grout) 

Name 

FX 

FB 

FE 

1 

Secretaries 

-2.00 

(-.55) 

0.45 

(.19) 

3.23 

(.84) 

2 

Technicians 

-0.81 

(-.41) 

-1.72 

(-.82) 

-1.01 

(-.32 

3 

S&E's 

-0.54 

(-.48) 

-0.37 

(-.40) 

-1.01 

(.84) 

4 

Group  Leaders 

0.62 

(.31) 

-0.21 

(-.13) 

-0.42 

(-.20) 

5 

Branch  Chiefs 

4.50 

(0.9) 

-0.14 

(-.08) 

3.33 

(1.27) 

#  None  of  the  above  differences  are  statistically  sig¬ 
nificant. 


and  Table  E-18  (1980)  in  Appendix  E.  The  1978  results 
showed  no  statistical  differences.  The  1979  ANOVA  results 
contained  only  one  significant  difference:  Technicians. 

The  Technicians  in  the  two  treatment  divisions,  FE  and  FG, 
had  higher  scores  than  FX  or  FB.  FB  Technicians  had  a  very 
low  score  compared  to  the  other  three  divisions.  In  the 
1980  ANOVA  results,  the  Technicians  had  the  only  signifi¬ 
cant  test  result,  primarily  due  to  a  sharp  drop  by  FB  Tech¬ 
nicians  rather  than  gains  by  the  treatment  divisions.  In 
fact,  FE  Technicians  dropped  in  F2  score  from  1979  to  1980 
while  FG  had  a  modest  gain.  A  brief  comment  concerning  FB 
Technicians  is  made  at  the  end  of  the  hierarchical  group 
analysis  section. 


lhe  longitudinal  results  for  this  factor  are  con¬ 
tained  in  Table  XIX.  Only  one  test  yielded  a  statistically 
significant  result.  Group  Leaders  in  FB  sustained  a  sig¬ 
nificant  (p  =  .05)  increase  in  F2. 


Table  XIX 

Longitudinal  Change  for  Hierarchical  Groups: 
Employ ee/Supervisor  Interaction  (F2) 


■  Means:  1980  -  1978 
(t-value) 

Group  Name  FX  FB  FE 


1 

Secretaries 

• 

-2.25 

(-.85) 

1 

Hill 

1 

2.17 

(.68) 

2 

Technicians 

-0.50 

(-.24) 

-2.94 

(-1.55) 

0.16 

(.08) 

3 

S&E’s 

-0.59 

(-.58) 

0.59 

(.71) 

0.76 

(.64) 

4 

Group  Leaders 

1.55 

(.73) 

3.53 

(2.18)* 

-0.86 

(-.36) 

5 

Branch  Chiefs 

O.83 

(.55) 

*p  < 

.05 

Discussion.  It  at  first  appeared  that  OD  may  have 
had  some  effect,  particularly  on  treatment  group  Techni¬ 
cians,  over  the  two  year  period.  Examination  of  these  re¬ 
sults  revealed  that  while  modest  positive  gains  were  made  by 
treatment  groups,  the  statistical  differences  rated  by  the 
ANOVAs  were  driven  by  drops  in  scores  sustained  by  FB  Tech¬ 
nicians  . 

Organizational  Warmth.  The  ANOVA  results  for  F3  are 
contained  in  Table  E-5  (1978),  Table  E-12  (1979)  and  Table 
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E-19  (1980)  in  Appendix  E.  The  results  contained  in  those 
Tables  paralleled,  somewhat,  the  results  discussed  above  for 
F2.  In  the  1978  ANOVA  no  statistically  significant  results 
were  revealed.  In  1979  the  ANOVA  depicted  significant  dif¬ 
ferences  for  Technicians,  S&E's,  and  Group  Leaders.  For 
Group  Leaders  the  significance  was  due  to  a  relatively  high 
value  for  FB  (control);  and  for  the  S&E's  relatively  high 
values  for  FB  and  FB  (treatment)  as  opposed  to  a  lower  value 
for  FX  (control).  For  the  Technicians,  a  drop  in  FB*s 
score  from  1978  to  1979 1  in  addition  to  gains  made  by  FE, 
plus  a  high  value  for  FG,  provided  the  significant  difference 
in  the  1979  ANOVA.  Examination  of  Table  E-19  for  the  re¬ 
sults  of  the  1980  ANOVA  showed  that  the  Group  Leaders  and 
S&E’s  differences  shown  in  the  1979  ANOVA  have  not  carried 
over  to  1980.  FE  Technicians  gain  on  F3  score  from  1978  to 
1979  evaporated  in  a  downturn  from  1979  to  1980.  FG  main¬ 
tained  a  modest  positive  gain  in  score  from  1979  to  1980  and 
this  coupled  with  the  continued  negative  trend  for  FB  Tech¬ 
nicians  led  to  the  significance  of  the  1980  ANOVA  for  Tech¬ 
nicians  . 

Table  XX  contains  the  results  of  the  longitudinal 
test  for  F3  from  1978  to  1980.  Only  one  test  achieved 
statistical  significance  and  that  was  for  Group  Leaders  in 
FB,  a  control  group. 

Discussion.  These  results  suggested  that  the  OD 
program,  at  best,  had  a  temporary  effect  for  FE  and  FG 
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Table  XX 

Longitudinal  Change  for  Hierarchical  Groups: 
Organizational  Warmth  (F3) 

Means:  1980  -  197$ 
(t-value) 

Group  Name  FX  FB  FE 


1 

Secretaries 

-4.75 

(-1.75) 

0.37 

(.20) 

0.63 

(.17) 

2 

Technicians 

1.83 

(1.11) 

-2.44 

(-1.61) 

-0.96 

(-.41 

3 

S&E’s 

-0.34 

(-.37) 

0.12 

(.01) 

0.99 

(.88) 

4 

Group  Leaders 

2.0  5 
(1.16) 

4.48 

(2.57)* 

0.73 

(.39) 

5 

Branch  Chiefs 

-1.00 

(-.63) 

1.21 

(.46) 

2.08 

(.56) 

*P  <  -02 


Technicians  on  this  factor.  This  effect  was  not  lasting  and 
had  basically  faded  by  the  time  of  the  1980  measurement.  The 
longitudinal  analysis  results  showed  that  FE  hierarchical 
groups  failed  to  make  any  significant  positive  gains  on  this 
factor  from  1978  to  1980. 

Organizational  Communication.  The  ANOVA  results  for 
F4  are  contained  in  Table  E-6  (1978),  Table  E-13  (1979)t  and 
Table  E-20  (1980)  in  Appendix  E.  The  ANOVA  for  1978  re¬ 
vealed  only  one  significant  difference.  Secretaries  in  FE 
(treatment)  had  a  low  score  compared  to  either  FB  or  FX 
(both  control).  This  was  opposite  to  the  expected  effect 
from  the  OD  process.  As  discussed  previously  in  this  chapter, 
this  could  have  been  due  to  the  changes  being  slower  than 
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anticipated.  The  results  for  1979  and  1980  ANOVAs  showed 
no  significant  differences  among  the  groups  on  F4. 

The  results  of  the  longitudinal  tests  are  contained 
in  Table  XXI.  FE  S&E's  were  almost  significant  at  p  =  .05 
with  FE  secretaries  not  far  behind.  Only  Group  Leaders  in 
FE  had  a  significant  gain,  but  four  out  of  five  groups  had 
positive  gains.  Technicians  had  negative  trends,  although 
not  significantly,  for  all  three  divisions.  The  most  sig¬ 
nificant  result  was  a  gain  by  FB  Group  Leaders  (p  =  .01). 


Table  XXI 

Longitudinal  Change  for  Hierarchical  Groupst 
Organizational  Communication  (f4) 


Means t  1980  -  1978  j 

(t-value)  ! 

Group 

Name 

FX 

FB 

FE 

1 

Secretaries 

-2.00 

0.48 

2.43 

<1.32) 

(.35) 

(1.15) 

2 

Technicians 

-0.08 

-0.86 

-0.42 

(.06) 

(-.79 

(  .29) 

3 

S&E's 

0.26 

0.03 

1.62 

(.41) 

( .05) 

(1.90) 

4 

Group  Leaders 

1.78 

4.05 

2.23 

(1.28) 

(3-59)** 

(2.13)* 

5 

Branch  Chiefs 

-1.00 

-0.21 

1.50 

(-.24) 

(-.10) 

(.46) 

*p  < 

.05  **p  <  .01 

Discussion.  The  results  of  the  hierarchical  group 
tests  generally  confirmed  the  conclusions  reached  from  the 
division  wide  data  for  this  factor.  OD  appeared  to  have 
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been  responsible  for  a  temporary  positive  effect  on  the 
treatment  divisions.  Between  1979  and  1980  this  effect  had 
begun  to  evaporate  with  S&E's  failing,  just  barely,  to 
achieve  a  significant  gain  for  the  two  year  test  and  Group 
Leaders  in  FE  just  achieving  significance  at  the  p  =  .05 
level.  Group  Leaders  in  FB,  a  control  group,  achieved  the 
highest  positive  change  with  a  significance  level  of  p  =  .01. 

Supervisory  Sup-port,  lhe  ANOVA  results  for  F5  are 
contained  in  Table  E-7  (1978),  Table  E-l4  (1979) »  and  Table 
E-21  (1980)  in  Appendix  E.  One  test  in  the  1978  ANOVA 
reached  statistical  significance*  the  very  low  score  by  FX 
Branch  Chiefs  in  comparison  to  the  nearly  equal  scores  of 
FB  and  FE  accounted  for  this  restilt.  In  1979  FX  Branch 
Chiefs  had  gained  sufficiently  on  this  factor  so  that  no 
statistically  significant  differences  existed  among  the 
groups.  In  the  1980  ANOVA,  FB  Technicians  continued  nega¬ 
tive  trend  for  this  factor  led  to  a  statistically  signifi¬ 
cant  result  (p  *  .007)  for  the  Technicians'  ANOVA. 

The  longitudinal  test  results  are  contained  in 
Table  XXII.  Only  the  Group  Leaders  in  FB  (control)  achieved 
a  statistically  significant  change  (positive)  on  F5  for  the 
two  year  period.  None  of  the  treatment  division  groups 
sustained  either  a  significant  positive  or  negative  change 
and  in  fact  FE  Group  Leaders  achieved  no  change  from  1978 
to  1980. 
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Table  XXII 

Longitudinal  Change  for  Hierarchical  Groups: 
Supervisory  Support  (F 5) 

Means:  19^0  -  197$ 

(t -value) 

Group  Name  FX  FB  FE 


1 

Secretaries 

0.20 

(.12) 

0.00 

(0) 

1.06 

(.61) 

2 

Technicians 

0.93 

(.76) 

-1.78 

(-1.74) 

-0.32 

(-.27) 

3 

S&E's 

-O.56 

(-.96) 

0.48 

(.98) 

0.6l 

(.99) 

4 

Group  Leaders 

1.01 

(1.05) 

2.60 

(1.97)* 

0.00 

(0) 

5 

Branch  Chiefs 

3.50 

(1.40) 

-0.39 

(-.25) 

-0.08 

(-.13) 

*p  <  .05 


Discussion.  The  results  indicated  that  the  team 
building  intervention  at  AFFBL  has  had  negligible  effect  on 
this  factor,  Supervisory  Support.  The  only  statistically 
significant  change  from  1978  to  1980  was  Group  Leaders  in 
FB,  a  non  treatment  group. 

One  disturbing  result  from  the  hierarchical  group 
analysis  should  be  noted  at  this  point  even  though  it  is  not 
involved  as  a  part  of  the  analysis  concerning  OD  effects. 

FB  Technicians  had  negative  trends  for  all  seven  of  the  cri¬ 
terion  measures.  Although  none  of  the  tests  (1978-1980) 
reached  statistical  significance,  this  is  a  possible  problem 
area  for  AFFDL  which  could  warrant  further  investigation  by 
AFFDL  management. 
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Divisional  Differences: 

Absenteeism 

As  discussed  in  Chapter  II,  AFFDL's  manhour  ac¬ 
counting  system  was  used  as  the  source  for  the  data  on  sick 
leave.  Data  were  available  monthly  and  by  division.  For 
each  measurement  (1978,  1979,  1980),  the  same  four  month 
period,  from  October  to  January,  was  used.  The  results  of  a 
one-way  ANOVA  for  each  year  are  contained  in  Table  XXIII 
(1978)  Table  XXIV  (1979),  and  Table  XXV  (1980).  The  means 
shown  in  those  tables  are  the  four-month  monthly  averages  of 
sick  leave  (total  number  of  hours  charged  to  sick  leave  di¬ 
vided  by  the  total  manhours  available  for  that  division  in 
the  particular  month)  for  each  of  the  four  AFFDL  product 
divisions  (Dekok,  1979il50). 

Divisional  Differences.  As  shown  in  Table  XXII  the 
low  rate  for  FX  (control)  was  responsible  for  the  signifi¬ 
cance  of  the  ANOVA.  No  OD  induced  effect  can  be  seen  in  the 
1978  data,  somewhat  due  to  the  lack  of  a  non-OD  baseline. 

The  1979  ANOVA,  Table  XXIV,  showed  that  significant  drops 
in  the  Absenteeism  rates  for  FE  and  FG  (both  treatment  divi¬ 
sions)  were  responsible  for  the  significance  of  the  ANOVA. 

The  1980  ANOVA  showed  that  the  1979  differences  had  evap¬ 
orated  resulting  in  no  statistically  significant  differences 
among  the  divisions  for  Absenteeism. 

Longitudinal  Change.  Table  XXVI,  below,  shows  the 
results  of  the  t-tests  for  change  from  1978  to  1980.  Dekok’ s 
results  for  the  1978  to  1979  longitudinal  analysis  showed 
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Table  XXIII 

Differences  Among  Divisions  on  Absenteeism  (1978) 


Division 

FX 

.0252 

(.0039) 

Mean  and  (Std 
FB 

.0395 

(.0075) 

.  Dev) 

FE 

.0371 
( .0027) 

FG 

F 

Value 

Absenteeism 

.0332 
( .0076) 

4.52* 

*P  <  .05 

Table  XXIV 

Differences 

Among  Divisions  on 

Absenteeism  (1979) 

Mean  and  (Std 

.  Dev) 

F 

Division 

FX 

FB 

FE 

FG 

Value 

Absenteeism 

.0320 

■  0337 

.0280 

.0219 

4.96* 

( .0041) 

( .0062) 

( .0035) 

( .0043) 

*P  <  .05 

Table  XXV 

Differences  Among  Divisions  on  Absenteeism  (1980)  # 


Mean  and  (Std.  Dev) 

F 

Division 

FX  FB 

FE 

FG 

Value 

Absenteeism 

.0307  .0229 

(.0047)  (.0037) 

.0333 
( .0082) 

.0279 

(.0037) 

2.12 

#  None  of  the 

above  results  are 

statistically  significant. 

Table  XXVI 

Longitudinal  Change  for  Divisions: 
Absenteeism  (1978-1980) 


FX 

;°°55 

(1.77) 


FB 

-.0166 

(-3.98)* 


( t-value) 

fe 

-.0038 

(-.88) 


FG 

-.0053 

(-1.25) 


that  both  treatment  divisions,  FE  and  FG,  has  statistically 
significant  drops  in  Absenteeism  rates  while  neither  of  the 
control  divisions,  FX  and  FB,  achieved  significant  results. 
The  longitudinal  analysis  for  1978  to  1980  confirmed  the 
ANOVA  results  discussed  above  in  that  the  significant  de¬ 
crease  in  rates  by  FE  and  FG  from  1978  to  1979  disappeared 
in  the  analysis  shown  in  Table  XXVI.  Only  FB,  a  control  di¬ 
vision,  achieved  statistical  significance  from  1978  to  1980 
with  a  decrease  in  Absenteeism  rate. 

Discussion.  Based  on  Dekok's  results  for  Absentee¬ 
ism  from  1978  to  1979 »  one  could  have  concluded  that  OD  was 
responsible  for  the  significant  improvement  in  the  rates  by 
the  treatment  divisions.  If  this  improvement  had  been  sus¬ 
tained  over  the  two  year  period  from  1978  to  1980,  this  con¬ 
clusion  would  have  been  the  logical  one  to  make.  However 
both  FE  and  FG  sustained  increased  rates  from  1979  to  1980 
thereby  wiping  out  the  significance  of  the  decreased  rates 
from  1978  to  1979-  Overall  both  FE  and  FG  still  had  nega¬ 
tive  trends  for  the  two  year  period  but  a  continued  upswing 
in  those  rates  for  another  year  could  negate  that  trend  over 
a  three  year  period.  Based  on  the  above  results  for  Absen¬ 
teeism,  it  was  concluded  that  if  OD  had  a  positive  effect 
and  was  responsible  for  the  decreases  in  treatment  group 
rates  it  was  a  temporary  effect  similar  to  the  situation 
discussed  previously  in  the  section  of  OC  Factor  Four,  Or¬ 
ganizational  Communication. 
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Factor  Trend  Plots 


As  a  means  of  graphically  displaying  the  results 
from  the  division  wide  ANOVAs  and  longitudinal  changes  from 
1978  to  1980  for  the  ten  criterion  measures  discussed  ear¬ 
lier  in  this  chapter,  plots  of  the  mean  division  values  for 
each  criterion  versus  time  (1978,  1979,  1980)  are  contained 
in  Appendix  G.  These  plots  confirmed  visually  the  discus¬ 
sion  provided  earlier  in  this  chapter  and  made  it  easier  to 
visualize  the  process  being  examined. 


IV  Summary  of  Results  and  Recommendations 


Summary  of  Research 

The  manner  in  which  the  AFFDL  OD  program  was  con¬ 
ducted  gave  rise  to  a  unique  opportunity  for  evaluation  of 
the  effectiveness  of  the  OD  program.  With  two,  of  four, 
divisions  participating  in  the  team  development  program  and 
the  remaining  two  divisions  electing  not  to  participate,  a 
naturally  occurring  treatment  group-control  group  setup  was 
available.  Previous  examinations  of  OD  program  in  other 
organizations  suffered  from  the  problems  discussed  in  Chap¬ 
ter  I.  As  stated  in  a  recent  article  reviewing  OD  in  the 
military: 

This  review  has  made  it  clear  that  the  percep¬ 
tion  of  success  is  based  largely  on  anecdotal  re¬ 
ports,  testimonials,  and  personal  involvement  of 
the  decision  makers.  Since  hard  data  and  rigorous 
empirical  research  are  lacking,  the  success  could 
be  illusionary  or  an  artifact  of  a  compliant  system 
[Umstot,  1980:198]. 

Umstot  went  on  to  state, 

Thus,  the  challenge  is  to  develop  an  empirical 
research  program  that  will  produce  measurable  re¬ 
sults  without  adverse  side  effects  (e.g.,  breach 
of  confidentiality,  feeling  of  being  manipulated, 
distorted  reporting,  and  false  expectations) 

[Umstot,  1980:199]. 

The  quasi -experimental  design  of  this  research,  as 
explained  in  Chapter  I,  was  intended  to  correct  the  above 


problems  and  control  for  most  sources  of  experimental  error. 
In  addition,  statistical  control  was  applied  to  all  quantita 
tive  analysis. 

This  research  was  intended  to  answer  one  basic  ques¬ 
tion,  as  stated  in  Chapter  Is 

Has  the  team  building  organizational  develop¬ 
ment  (OD)  intervention  at  the  Air  Force  Flight  Dy¬ 


namics  Laboratory  (AFFDL)  had  any  measurable  effect 
on  the  various  organizational  goals  that  were  stated 
for  the  program?  Out  of  this  basic  problem  state¬ 
ment  evolved  the  primary  and  secondary  hypothesis 
as  well  as  the  five  sub-objectives  stated  in 
Chapter  I. 

The  goals  that  were  articulated  for  the  AFFDL  OD 
program  included:  "goals  of  people  working  harder,  or  better 
or  feeling  better  about  the  laboratory  [Stahl,  et  al,  1978: 
2j."  It  was  against  these  goals  that  the  effectiveness  of 
the  OD  program  at  AFFDL  was  to  be  measured.  Towards  that 
end  the  survey  instrument  described  in  Chapter  II  was  de¬ 
signed  and  utilized  to  measure  an  individual's  productivity, 
perceptions  concerning  organizational  climate  at  AFFDL,  job 
satisfaction,  and  job  motivation.  Division-wide  data  on 
absenteeism  was  obtained  from  AFFDL  internal  records . 

Dekok's  analysis  of  the  1978  and  1979  data  produced 
results  which  were  both  contradictory  and  puzzling  with  re¬ 
spect  to  providing  an  unequivocal  answer  to  the  basic  ques¬ 
tion  and  hypotheses  (Dekok,  1979« 167-8). 
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The  results  of  this  research,  which  included  the 
1978,  1979,  and  1980  data,  are  unequivocal  and  conclusive. 
Those  results,  presented  in  Chapter  III,  are  summarized  in 
the  next  section  in  relationship  to  the  hypotheses,  sub¬ 
objectives,  and  problem  statement  provided  in  Chapter  I. 
Possible  reasons  for  the  results  of  this  research  and  rec¬ 
ommendations  concerning  the  AFFDL  OD  program,  are  provided 
in  the  concluding  sections. 

Summary  of  Results 

The  AFFDL  team  building  intervention  has  been  under¬ 
way  for  over  four  years.  While  it  is  generally  agreed  that 
humanistic  process  type  interventions  are  slow  to  change  an 
organization,  lasting  positive  effects  should  have  been  de¬ 
tected  in  the  eleven  criterion  measures  used  in  this  re¬ 
search  by  the  time  of  the  1980  measurement.  The  objective 
of  this  section  is  to  review  the  results  presented  in  Chap¬ 
ter  III  in  relationship  to  the  basic  problem  statement, 
hypotheses,  and  sub-objectives  stated  in  Chapter  I. 

Primary  Hypothesis.  The  primary  hypothesis  of  this 
thesis  was  stated  in  Chapter  I  as* 

Divisions  which  are  involved  in  the  team  de¬ 
velopment  effort  showed  more  positive  change  on 
criterion  variables  than  divisions  which  are  not 
involved  in  the  OD  program  [Dekok,  1979*9]. 

Based  on  the  analysis  of  data  from  three  measure¬ 
ments  from  1978  to  1980,  this  hypothesis  cannot  be  sup¬ 
ported.  None  of  the  significantly  positive  changes  in  the 
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criterion  variables  which  were  revealed  by  Dekok' s  1978- 
1979  analysis  were  sustained  to  the  1980  analysis.  0D  treat¬ 
ment  divisions  failed  to  exhibit  any  statistically  signifi¬ 
cant  change  on  any  of  the  eleven  criterion  variables  used 
in  this  analysis  from  1978  to  1980.  Most  disturbing  was  the 
negative  trends,  although  not  statistically  significant,  for 
two  of  the  productivity  measures  for  FE,  a  treatment  divi¬ 
sion.  Finally,  after  more  than  four  years  of  OD  work  at 
AFFDL,  the  four  product  divisions  were  virtually  ^inseparable 
statistically . 

The  only  bright  spot  in  this  analysis  for  OD  was  its 
apparent  effect,  from  1978  to  1979,  on  Organization  Communi¬ 
cation,  F4.  This  effect  essentially  disappeared  by  the  time 
of  the  1980  measurement.  This  OD  induced  effect,  as  well  as 
any  others,  was  temporary  and  could  have  been  a  "Hawthorne 
effect".  Possible  reasons  for  this  lack  of  permanent  effect 
by  OD  or.  the  AFFDL  treatment  divisions  are  discussed  in  the 
next  section. 

Secondary  Hypothesis.  As  stated  by  Dekok,  "the 
secondary  hypothesis  of  this  research  emanated  directly 
from  the  organizational  change  model  (originally  proposed  by 
Likert)  used  in  this  study  [Dekok,  1979s 1651 . "  It  was  stated 
as: 

Intervening  variables  (primarily  those  associ¬ 
ated  with  organizational  climate)  exhibited  less 
positive  change  than  end-result  variables  (pro¬ 
ductivity  and  absenteeism)[Dekok,  1979:91. 
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The  results  of  the  analysis  of  the  AFFDL  data  do 
not  support  this  hypothesis.  Although  failing  to  achieve 
statistical  significance ,  more  climate  variables  showed 
positive  change  than  productivity  where  two  out  of  three 
showed  negative  trends  for  treatment  divisions.  The  final 
end  result  variable,  Absenteeism,  failed  to  sustain  its 
positive  effect  (lower  rates)  for  the  treatment  divisions 
over  the  two  year  period.  Based  on  Likert’s  model  and  the 
fact  that  the  OD  program  has  been  underway  at  AFFDL  for 
over  four  years,  positive  changes  should  have  been  seen  in 
the  treatment  divisions  for  the  end-result  variables. 

Sub -Objectives.  In  Dekok's  thesis  he  proposed  five 
objectives  requiring  further  study  following  a  third  measure¬ 
ment  of  AFFDL  personnel.  Hiose  objectives,  as  stated  in 
Chapter  I,  are  listed  below  with  the  general  results  for 
each  objective. 

1 .  Confirm  or  deny  that  the  process  of  OD-induced 
organizational  change  is  still  occurring  within  the  labora¬ 
tory. 

Result;  Hie  analysis  results  presented  in  Chapter 
III  tend  to  deny  that  OD  induced  change  is  still  occurring 
within  the  AFFDL  organization. 

2.  Observe  if  more  of  the  perceptual  measures  ex¬ 
hibit  statistically  significant  change  over  a  two  year  period. 

Result;  As  shown  in  Chapter  III,  none  of  the  percep¬ 
tual  (climate)  measures  exhibited  statistically  significant 

change  over  the  two  year  period. 
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3.  Resolve  the  absenteeism  issue  for  FE  and  FG. 
Confirm  or  deny  that  this  is  an  effect  that  can  be  unequiv¬ 
ocally  attributed  to  the  OD  program. 

Result:  Based  on  the  results  in  the  absenteeism 
section  of  Chapter  III,  changes  seen  in  absenteeism  rates 
in  FE  and  FG,  for  1978-1979 •  cannot  be  unequivocally  attrib¬ 
uted  to  the  OD  program.  FE  and  FG  sustained  increased 
rates  from  1979  to  1980  thereby  wiping  out  any  statistical 
significance  for  1978  to  1980  longitudinal  analysis.  If  OD 
was  responsible  for  the  initial  positive  effect  (1978  to 
1979).  it  was  temporary. 

4.  Observe  if  the  fall  in  the  scores  of  FX  employees 
on  the  immediate  work  group  dimension  of  organizational  cli¬ 
mate  is  a  continuing  event,  and  ascertain  its  probable 
causes . 

Resulti  In  the  analysis  presented  earlier  in  Chap¬ 
ter  III,  FX  did  have  a  drop  in  score  for  Climate  Factor  One 
from  1978  to  1979  but  gained  from  1979  to  1980  which  led  to 
no  statistically  significant  changes  from  1978  to  1980. 

5.  Resolve  the  productivity  issues  for  FE  and  FG. 
Investigate  whether  productivity  is  a  static  or  cyclical 
variable  within  AFFDL,  and  if  cyclical,  determine  its  period. 

Result!  There  is  no  evidence  to  support  a  claim 
that  productivity  is  cyclical  in  nature  with  AFFDL.  FE  and 
FG  generally  increased  productivity  slightly  from  1979  to 
1980  but  had  an  overall  negative  trend  for  1978  to  1980 


although  none  of  the  results  were  statistically  significant. 
The  productivity  items  used  in  the  survey,  as  listed  in 
Chapter  II  are  highly  dependent  on  U.S.  R&D  policy,  and  the 
resultant  decisions  from  Congress  down  to  the  laboratory 
level.  This  could  have  had  a  large  effect  on  the  productiv¬ 
ity  measures  used  in  this  study. 

The  data  and  results  presented  in  Chapter  III,  and 
discussed  above,  show  that  despite  having  been  underway  for 
over  four  years,  the  AFFDL  OD  program  has  had  no  lasting 
measurable  positive  effect  on  the  goals  stated  for  the  pro¬ 
gram.  This  was  the  same  situation  perceived  by  several 
treatment  group  members.  As  one  wrote  on  the  comment  page 
of  the  survey* 

I  must  say  that  since  this  time  last  year  when 
the  2nd  step  in  the  "continuing  assessment  of  the 
effectiveness  of  the  team  development  program"  was 
conducted,  I  have  witnessed  no  difference  whatso¬ 
ever  in  any  facet  of  AFFDL’ s  usual  way  of  doing 
things.  It  would  be  interesting  to  know  if  any 
discemable  results  are  ever  expected  by  FDL’s 
top  management,  and  what,  indeed,  they  might  be 
[GS-12,  S&E  in  FG]. 

Potential  reasons  for  this  lack  of  permanent,  dis¬ 
cemable  effect  by  the  OD  program  at  AFFDL  are  discussed  in 
the  next  section  of  this  chapter. 


Potential  Reasons  for  Results 

Many  alternative  reasons  could  be  found  to  explain 
the  lack  of  any  positive,  significant,  measurable  effect  by 
the  AFFDL  program  on  its  stated  goals.  Four  basic  potential 
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explanations/reasons  are  discussed  in  this  section  of  Chapter 
IV.  They  are  by  no  means  the  only  possible  reasons  nor  are 
the  discussions  intended  to  be  exhaustive. 

1.  It  is  apparent  from  discussions  with  AFFDL  per¬ 
sonnel  and  previous  AFIT  researchers  that  the  vital  diagnos¬ 
tic  stage  discussed  in  Chapter  I  was  not  complete  as  neces¬ 
sary  for  success.  A  complete  and  accurate  diagnostic  stage 
is  critical  in  finding  out  what,  if  anything,  is  wrong  with 
an  organization  and  if  problems  are  discovered  what  tech¬ 
niques  or  combination  of  techniques  may  be  most  effective. 

An  incomplete  or  inaccurate  diagnostic  stage  can,  as  in  the 
medical  world,  lead  to  the  incorrect  treatment  of  the  "dis¬ 
ease".  At  best  this  problem  can  cause  the  situation  to  get 
no  worse,  with  perhaps  a  temporary  or  placebo  effect  improve¬ 
ment.  At  worst  it  can  complicate  a  situation,  perhaps  de¬ 
lay  treatment  of  the  correct  problem.  A  more  complete  diag¬ 
nostic  stage  might  have  added  AFFDL  management  in  both  goal 
formation  and  treatment  selection.  Several  AFFDL  personnel 
also  stated  the  above  sentiment  in  written  comments.  One 
S&E's  comment  was  typical  concerning  the  OD  program  at  AFFDL t 

...  is  concerned  primarily  with  facilitating 
dialogue,  and  only  secondarily  with  achieving  any 
results  relevant  to  the  solution  of  existing  pro¬ 
blems  [GS-12,  S&E,  in  FGj . 


2.  Possibly  as  a  result  of  an  inadequate  diagnostic 
phase,  the  stated  goals  for  the  AFFDL  OD  program  are  vague. 
As  discussed  in  Chapter  I,  these  goals  were  not  formalized 


and  written  down.  This  created  considerable  difficulty  in 
defining  precisely  what  the  laboratory  expected  to  accom¬ 
plish  and  how  to  measure  that  accomplishment.  Poor  goal 
formulation  is  often  cited  as  a  major  contributor  to  program 
failure.  More  definitive  and  measurable  goals  could  have 
provided  a  more  solid  basis  from  which  to  measure  goal  ac¬ 
complishment  and  to  guide  program  implementation. 

3*  The  AFFDL  OD  program  lacked  sufficient  intensity 
and  visibility  to  produce  and  maintain  positive  results.  As 
previously  discussed,  where  positive  results  did  occur,  they 
basically  disappeared  by  the  time  of  the  1980  measurement. 
The  AFFDL  OD  program  is  a  low-key  approach,  with  most  ses¬ 
sions  being  informal,  voluntary  and  not  always  well  publi¬ 
cized.  Also  as  stated  by  Dekok* 

What  separates  the  OD  effort  at  AFFDL  from 
those  at  other  organizations  on  the  base  (AFML 
and  AFAJL)  is  that  AFFDL  has  no  internal  OD  facil¬ 
itator  to  work  with  divisions  during  Dr.  Lehner's 
absences  [Dekok,  1979*169]. 

The  lack  of  an  internal  facilitator  was  particularly 
a  problem  for  the  AFFDL  OD  program.  A  low  key  program, 
such  as  used  at  AFFDL,  could  have  benefited  greatly  from  a 
trained  internal  facilitator  to  maintain  both  program  in¬ 
tensity  and  visibility  between  Dr.  Lehner's  visits.  Without 
such  a  focal  point  within  the  laboratory,  the  OD  program  ex¬ 
perienced  peaks  and  valleys  of  interest  and  therefore, 
lacked  continuity. 

4.  The  final  possible  reason/explanation  for  the 
results  of  the  AFFDL  OD  program  was  stated  by  Dekok  ast 


.  .  .  neither  a  pure  "human"  or  "technological" 
approach  is  possible  in  practice.  In  fact,  there 
is  considerable  evidence  to  suggest  that  interven¬ 
tions  aimed  at  one  element,  to  the  exclusion  of 
the  other,  produce  particularly  disappointing  re¬ 
sults  [Dekok,  1979 « 23]. 

The  AFFDL  OD  program  concentrated  totally  on  team  development, 
a  humanistic  approach.  The  lack  of  permanent  change  in  the 
perceived  way  AFFDL  conducted  business  was  partly  responsible 
for  the  lack  of  permanent  effect  by  the  OD  program.  Two 
comments  by  AFFDL  personnel  serve  to  highlight  this  problems 

.  .  .  unless  something  discernible  happens  as 
a  result  of  the  various  surveys,  self-help  inspec¬ 
tions,  team  development  programs,  etc.,  etc.,  it 
would  be  far  better  for  FDL  management  to  do  nothing 
at  all  [GS-12,  S&E  in  FG] . 

.  .  .  There  are  no  job  enriching  experiences,  or 
responsible  challenging  engineering  assignments 
[GS-12,  S&E  in  FG] . 

Although  government  organizations  are  severaly  lim¬ 
ited  in  the  structural  alternatives  available,  the  complete 
lack  of  any  such  techniques  to  add  strength  and  permanence 
to  the  overall  program  led  to  problems  for  the  AFFDL  OD 
effort. 


Recommendations 

The  recommendations  which  follow  evolved  out  of  the 
results  of  this  research  as  well  as  other  research  work  on 
this  topic  and  others  in  the  organizational  development  area. 
These  recommendations  concern  the  team  development  OD  pro¬ 
gram  at  AFFDL. 

1.  Terminate  the  current  AFFDL  OD  program.  Note 

the  emphasis  on  the  word  current.  This  recommendation 
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refers  only  to  the  team  building  intervention  that  has  been 
underway  at  AFFDL  for  over  four  years  and  its  particular 
characteristics  and  implementation.  As  discussed  in  Chap¬ 
ter  I  in  the  section  on  Scope  and  Limitations,  no  attempt 
should  be  made  to  generalize  these  results  to  other  OD  pro¬ 
grams.  This  recommendation  is  based  on  the  results  pre¬ 
sented  in  Chapter  III  and  also  discussed  in  this  chapter. 

The  current  program,  simply  stated,  did  not  accomplish  its 
stated  goals. 

2.  If  AFFDL  management  wishes  to  continue  utilizing 
programs  of  organizational  change  to  improve  organizational 
effectiveness  the  following  steps  are  recommended: 

a.  Perform  a  complete  and  accurate  diagnostic 
stage  prior  to  selecting  any  technique  or  group  of  tech¬ 
niques  for  use.  This  is  a  critical  step  for  success. 

b.  Set  clear  and  definitive  goals  for  any  pro¬ 
gram  to  be  undertaken. 

c .  Based  on  the  results  of  the  diagnostic  stage 
and  goal  setting,  consider  as  wide  a  range  of  techniques  as 
possible  including  structural  and  humanistic  approaches. 

d.  Consider  problems  of  implementation  care¬ 
fully.  Visibility  and  intensity  are  important  factors. 

3*  If  a  diagnostic  stage  is  entered  in  the  future, 
consideration  should  be  given  to  utilizing  the  data  from  the 
three  measurements  used  in  this  research  as  one  possible 
diagnostic  tool. 


9? 
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APPENDIX  A 
SURVEY  INSTRUMENT 
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1 


PRIVACY  ACT  STATEMENT 


In  accordance  with  para  30,  AFR  12-35*  Air  Force  Privacy  Act 
Program,  the  following  information  about  this  survey  is  pro¬ 
vided  as  required  by  the  Privacy  Act  of  197^. 

a.  Authority.  This  survey  information  is  authorized 
for  solicitation  by  Federal  Statute  Title  10,  United  States 
Code,  Section  8012,  Executive  Order  9397*  DODI  1100.13* 

17  April  1968,  and  AFR  30-23,  22  Sept  ?6. 

b.  Principle  Purpose.  This  survey  is  being  con¬ 
ducted  to  gain  the  attitudes  and  opinions  of  Air  Force  R&D 
personnel  toward  Team  Development  programs. 

c.  Routine  use.  The  survey  data  will  be  converted 
to  statistical  information  for  use  by  AFIT  researchers  and 
laboratory  personnel. 

d.  participation  in  this  survey  is  entirely  volun¬ 
tary. 

e.  No  adverse  action  of  any  kind  may  be  taken 
against  any  individual  who  elects  not  to  participate  in  any 
or  all  of  this  survey. 


USAF  SCN  78-7 
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I.  BIOGRAPHIC  INFORMATION 

Please  circle  the  appropriate  letter. 

1.  How  old  were  you  on  your  last  birthday? 


A. 

Less  than  25  years 

F. 

45-49  years 

B. 

25-29  years 

G. 

50-54  years 

C. 

30-34  years 

H. 

55-59  years 

D. 

E. 

35-39  years 

40-44  years 

I. 

Over  59  years 

2.  What  is  your  present  grade? 


A. 

GS  2-4 

G. 

E1-E5 

B. 

GS  5-7 

H. 

E6-E9 

C. 

GS  8-11 

I. 

01  or  02 

D. 

GS  12 

J. 

03 

E. 

GS  13 

K. 

04-05 

F. 

GS  14-16  or  PL  313 

How 

long  have  you  been  assigned 

to 

your  current 

division? 

A. 

Less  than  6  months 

D. 

2  years  but 

less  than 

3 

years 

B. 

6  months  but  less  than 

E. 

3  years  but 

less  than 

4 

years 

1  year 

F. 

4  years  but 

less  than 

5 

years 

C. 

1  year  but  less  than 

G. 

More  than  5 

years 

2  years 


How 

long  have  you  been 

assigned  to 

this  laboratory? 

A. 

Less  than  2  years 

E. 

16-20  years 

B. 

2-5  years 

F. 

21-25  years 

C. 

D. 

6-10  years 

11-15  years 

G. 

More  than  25  years 

5.  What  is  your  highest  level  of  formal  education? 

A.  Some  high  school  (no  diploma) 

B.  High  school  graduate  (no  college) 

C.  Some  college  or  technical  school  (no  degree) 

D.  Bachelor’s  degree 

E.  Some  graduate  work  (no  degree) 

F.  Master's  degree 

G.  Some  work  beyond  master's  degree  (no  doctorate) 

H.  Doctoral  degree 


6.  To  which  division  are  you  currently  assigned? 


A. 

Aeromechanics 

D.  Collocated  in 

B. 

Structural  Mechanics 

from  another  organization 

C. 

Vehicle  Equipment 

E.  Flight  Control 

7.  What  is  your  current  job/position? 


A. 

Clerk,  Stenographer  or 

C. 

Scientist  or  engineer 

Secretary 

D. 

Group  leader 

B. 

Technician 

E. 

Branch  chief 

F. 

Other 

II.  ORGANIZATIONAL  CLIMATE 


Please  circle  the  appropriate  letter  for  each  of  the  following  eight 
questions. 

8.  Which  one  of  the  following  shows  how  much  of  the  time  you  feel 
satisfied  with  your  job? 


A. 

Never 

E. 

A  good  deal  of  the  time 

B. 

Seldom 

F. 

Most  of  the  time 

C. 

D. 

Occasionally 

About  half  of  the  time 

G. 

All  the  time 

9.  Choose  one  of  the  following  statements  which  best  tells  how  well 
you  like  your  job. 


A. 

I 

hate  it 

E. 

I 

like  it 

B. 

I 

dislike  it 

F. 

I 

am  enthusiastic  about  it 

C. 

I 

don't  like  it 

G. 

I 

love  it 

D. 

I 

am  indifferent  to  it 

10.  Which  one  of  the  following  best  tells  how  you  feel  about  changing  your  job? 

A.  I  would  quit  this  job  at  once  if  I  could. 

B.  I  would  take  almost  any  other  job  in  which  I  could  earn  as  much  as 

I  am  earning  now. 

C.  I  would  like  to  change  both  my  job  and  my  occupation. 

D.  I  would  like  to  exchange  my  present  job  for  another  job. 

E.  I  am  not  eager  to  change  my  job,  but  I  would  do  so  if  I  could 

get  a  better  job. 

F.  I  cannot  think  of  any  jobs  for  which  I  would  exchange. 

G.  I  would  not  exchange  my  job  for  any  other. 
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11.  Which  one  of  the  following  shows  how  you  think  you  compare  with 
other  people? 

A.  No  one  dislikes  his  job  more  than  I  dislike  mine. 

B.  I  dislike  my  job  much  more  than  most  people  dislike  theirs. 

C.  I  dislike  my  job  more  than  most  people  dislike  theirs. 

D.  I  like  my  job  about  as  well  as  most  people  like  theirs. 

E.  I  like  my  job  better  than  most  people  like  theirs. 

F.  I  like  my  job  much  better  than  most  people  like  theirs. 

G.  No  one  likes  his  job  better  than  I  like  mine. 


12.  On  most  work  days,  how  often  does  time  seem  to  drag  for  you? 

A.  About  half  the  day  or  more  D.  About  1/8  of  the  day 

B.  About  1/3  of  the  day  E.  Time  never  seems  to  drag 

C.  About  1/4  of  the  day 


13.  Some  people  are  completely  involved  in  the  job — they  are  absorbed 
in  it  night  and  day.  For  others,  their  job  is  simply  one  of  several 
interests.  How  involved  do  you  feel  in  your  job? 

A.  Very  little;  my  other  interests  are  more  absorbing 

B.  Slightly  involved 

C.  Moderately  involved;  my  job  and  my  other  interests  are  equally 

absorbing  to  me 

D.  Strongly  involved 

E.  Very  strongly  involved;  my  work  is  the  most  absorbing  interest 

in  my  life 


14.  How  often  do  you  do  extra  work  for  your  job  which  is  not  really 
required  of  you? 

A.  Almost  every  day 

B.  Several  times  a  week 

C.  About  once  a  week 

D.  Once  every  few  weeks 

E.  About  once  a  month  or  less 


15.  Would  you  say  you  work  harder,  less  hard  or  about  the  same  as  other 
people  doing  your  type  of  work  in  your  work  organization? 

A.  Much  harder  than  most  others 

B.  A  little  harder  than  most  others 

C.  About  the  same  as  most  others 

D.  A  little  less  hard  than  most  others 

E.  Much  less  hard  than  most  others 
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Please  indicate  your  degree  of  agreement /disagreement ,  or  the  extent  to  which 
the  following  exist  by  circling  the  appropriate  letter  for  each  question. 

16.  The  amount  of  information  you  receive  about  what  is  going  on  in  the 
laboratory  within  your  immediate  work  group  is  adequate  to  meet  your  needs. 

A.  Definitely  disagree  D.  Inclined  to  agree 

B.  Inclined  to  disagree  E.  Definitely  agree 

C.  Undecided 


17.  To  what  extent  do  the  objectives  of  your  work  group  support  the 
objectives  of  the  laboratory? 


A. 

To 

a  very  little  extent 

D. 

To  a 

great  extent 

B. 

To 

a  little  extent 

E. 

To  a 

very  great  extent 

C. 

To 

some  extent 

18.  I  am  given  credit  for  the  work  I  have  done. 

A.  Definitely  disagree  D.  Inclined  to  agree 

B.  Inclined  to  disagree  E.  Definitely  agree 

C .  Undecided 


19.  When  you  talk  with  your  supervisor,  to  what  extent  does  he  pay 
attention  to  what  you  are  saying? 


A. 

To 

a  very  little  extent 

D. 

To 

a  great  extent 

B. 

C. 

To 

To 

a  little  extent 
some  extent 

E. 

To 

a  very  great  extent 

20.  As  far  as  I  can  see,  there  isn't  very  much  personal  loyalty  to  the 
laboratory. 

A.  Definitely  disagree  D.  Inclined  to  agree 

B.  Inclined  to  disagree  E.  Definitely  agree 

C .  Undecided 


21.  Within  my  working  group,  I  can  make  decisions  and  solve  problems 
without  checking  with  my  supervisor  each  step  of  the  way. 

A.  Definitely  disagree  D.  Inclined  to  agree 

B.  Inclined  to  disagree  E.  Definitely  agree 

C.  Undecided 
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22.  A  friendly  atmosphere  prevails  among  the  people  in  my  work  group. 


A.  Definitely  disagree  D.  Inclined  to  agree 

B.  Inclined  to  disagree  £.  Definitely  agree 

C .  Undecided 


23.  The  promotion  system  is  effective  (i.e.,  the  right/most  qualified  person 
generally  receives  a  promotion  when  one  opens  up) . 

A.  Definitely  disagree  D.  Inclined  to  agree 

B.  Inclined  to  disagree  E.  Definitely  agree 

C .  Undecided 


24.  To  what  extent  does  your  supervisor  maintain  high  personal  standards 
of  performance? 


A. 

To 

a  very  little  extent 

D. 

To 

a  great  extent 

B. 

To 

a  little  extent 

E. 

To 

a  very  great  extent 

C. 

To 

some  extent 

25. 

To 

what  extent  are  those  above 

you 

willing  to  listen  to  vour  ideas  and 

suggestions? 

A. 

To  a  very  little  extent 

D. 

To 

a  great  extent 

B. 

To  a  little  extent 

E. 

To 

a  very  great  extent 

C. 

To  some  extent 

26. 

To 

what  extent  do  members  in  your  work 

group  help  you  find  ways  to 

improve 

your  performance? 

A. 

To  a  very  little  extent 

D. 

To 

a  great  extent 

B. 

To  a  little  extent 

E. 

To 

a  very  great  extent 

C. 

To  some  extent 

27.  When  I  am  assigned  a  job,  I  know  what  is  expected  of  me. 

A.  Definitely  disagree  D.  Inclined  to  agree 

B.  Inclined  to  disagree  E.  Definitely  agree 

C.  Undecided 


28.  To  what  extent  does  your  work  group  plan  together  and  coordinate  its 
efforts? 

A.  To  a  very  little  extent  D.  To  a  great  extent 

B.  To  a  little  extent  E.  To  a  very  great  extent 

C.  To  some  extent 
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29.  In  my  branch  the  rewards  and  encouragements  you  get  usually  outweigh  the 
threats  and  the  criticism. 


A. 

Definitely  disagree 

D. 

Inclined  to  agree 

B. 

Inclined  to  disagree 

E. 

Definitely  agree 

C. 

Undecided 

30. 

My 

supervisor  is  friendly  and 

easy 

to  approach. 

A. 

Definitely  disagree 

D. 

Inclined  to  agree 

B. 

Inclined  to  disagree 

E. 

Definitely  agree 

C. 

Undecided 

31. 

When  you  talk  with  members  in 

your 

work  group,  to  what  extent  do  they 

pay 

attention  to  what  you  are  saying? 

A. 

To  a  very  little  extent 

D. 

To  a  great  extent 

B. 

To  a  little  extent 

E. 

To  a  very  great  extent 

C. 

To  some  extent 

32. 

To 

what  extent  do  members  in  your  work  group  exchange  opinions  and  ideas 

A. 

To  a  very  little  extent 

D. 

To  a  great  extent 

B. 

To  a  little  extent 

E. 

To  a  very  great  extent 

C. 

To  some  extent 

33. 

People  in  this  organization  take  pride  in  the  excellence  of  their 

performance. 

A. 

Definitely  disagree 

D. 

Inclined  to  agree 

B. 

Inclined  to  disagree 

E. 

Definitely  agree 

C. 

Undecided 

34.  In  my  branch  people  are  rewarded  in  proportion  to  the  excellence  of 
their  job  performance. 

A.  Definitely  disagree  D.  Inclined  to  agree 

B.  Inclined  to  disagree  E.  Definitely  agree 

C.  Undecided 


35.  To  what  extent  do  you  have  confidence  and  trust  in  members  of  your  work 
group? 

A.  To  a  very  little  extent  D.  To  a  great  extent 

B.  To  a  little  extent  E.  To  a  very  great  extent 

C.  To  some  extent 
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36.  Decisions  are  usually  made  by  Che  people  with  the  most  relevant  Information, 
no  matter  what  their  position  in  the  organization. 


A. 

Definitely  disagree  D. 

Inclined  to  agree 

B. 

Inclined  to  disagree  £. 

Definitely  agree 

C. 

Undecided 

37.  To 

what  extent  does  your  supervisor  encourage  people  to  give  their  best 

effort? 

A. 

To  a  very  little  extent  D. 

To  a  great  extent 

B. 

To  a  little  extent  E. 

To  a  very  great  extent 

C. 

To  some  extent 

38.  To  what  extent  are  those  with  whom 
information,  ideas  and  suggestions? 

you 

work  directly  willing  to  share 

A. 

To  a  very  little  extent 

D. 

To 

a  great  extent 

B. 

C. 

To  a  little  extent 

To  some  extent 

E. 

To 

a  very  great  extent 

39.  I 

have  the  opportunity  to 

influence 

major  decisions  within  my  work  group 

A. 

Definitely  disagree 

D. 

Inclined  to  agree 

B. 

Inclined  to  disagree 

E. 

Definitely  agree 

C. 

Undecided 

40.  Around  here  there  is  a  feeling  of  pressure  to  continually  improve 
personal  and  group  performance. 


A. 

Definitely  disagree 

D.  Inclined  to  agree 

B. 

Inclined  to  disagree 

E.  Definitely  agree 

C. 

Undecided 

41.  Information  is  widely  shared  within  the  laboratory  so  that  those  who 
make  decisions  have  access  to  all  available  facts. 


A. 

Definitely  disagree 

D. 

Inclined  to  agree 

B. 

C. 

Inclined  to  disagree 
Undecided 

E. 

Definitely  agree 

42.  The  amount  of  information 
branch  is  adequate  to  meet  your 

vou  receive  about  what  is  going  on  within  your 
needs. 

A. 

Definitely  disagree 

D. 

Inclined  to  agree 

B. 

C. 

Inclined  to  disagree 
Undecided 

E. 

Definitely  agree 
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43.  To  what  extent  does  your  supervisor  encourage  the  people  who  work  for 
him  to  exchange  opinions  and  ideas? 

A.  To  a  very  little  extent  D.  To  a  great  extent 

B.  To  a  little  extent  E.  To  a  very  great  extent 

C.  To  some  extent 


44.  When  decisions  are  being  made,  to  what  extent  are  the  people  affected 
asked  for  their  ideas? 


A. 

To 

a  very  little  extent 

D. 

To 

a  great  extent 

B. 

To 

a  little  extent 

E. 

To 

a  very  great  extent 

C. 

To 

some  extent 

45.  The  amount  of  information  you  receive  about  what  is  going  on  within 
your  division  is  adequate  to  meet  your  needs. 

A.  Definitely  disagree  D.  Inclined  to  agree 

B.  Inclined  to  disagree  E.  Definitely  agree 

C.  Undecided 
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III.  NATURE  OF  WORK  QUESTIONS 


This  section  is  to  be  filled  out  by  scientists  and  engineers,  group  leaders 
and  branch  chiefs  only. 


Indicate  what  percent  of  your  time  at  work  is  spent  doing  each  of  the  activities 
listed  in  the  next  five  items.  The  five  items  are  considered  a  set,  and  responses 
to  them  should  total  100  percent. 


(46,47)* 

_ % 

In-House  Research  and  Development 

(48,49) 

_ % 

Contract  R&D  Guidance 

(50,51) 

% 

Technical  Support  of  Others 

(52,53) 

% 

Program  Administration  (includes  planning,  budgeting,  documentation 
of  programs,  etc.) 

(54,55) 

% 

Supervision 

Indicate  how  many  of  the  following  you  have  authored/presented/briefed  over  the 

past  year. 

(56,57)  _  Published  Papers  in  Professional/Technical  Journals 

(58,59)  _  Technical  Reports 

(60,61)  _  Technical  Memorandums  or  Test  Data  Reports 

(62,63)  _  Presentations  at  Symposia,  Meetings  of  Professional  Organizations, 

and  Technical  Conferences 

(64,65)  _  Hardware/Software  Specifications,  Statements  of  Work,  Requests 

for  Proposals,  Test  Plans,  and  Test  Reports 

(66,67)  _  In-House  Studies,  Technical  and/or  Managerial  Assessments 

(68,69)  _  Presentations  to  General  Office  Level  Audiences  (count  multiple 

audiences  of  same  presentation  as  one) 

(70,71)  _  Professional  or  Technical  Committee  Participation  (external  to 

laboratory) 


*  Numbers  are  for  keypunching 
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APPENDIX  B 

FACTOR  ANALYSIS  OF  ORGANIZATIONAL  CLIMATE  ITEMS 
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Table  B-l 

Factor  Analysis  of  Climate  Questions  --  Combined  Data  (N  =  106l) 


vO  C^-GO  O'.  O  C4  C"\.^  \TWO  r^-GO  0s  O  r-»  *V1  vnvO  P'-CO  (>0  hOJ 

^  ,-t  ft  w  oj  cvjcsjcvjCNjcvicvjojcJcnr^f^rNc^r^r^c^r^  4-  ^ 

aararaKyaKyarararararcraranyarcyatarcKyar  ctararcj  at  or 
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Q45  .03461  .37968  .379^  .73680  .13394 

Eigenvalue  10.57  2.01  1.51  1-34  1.20 

Percent  Variance 

Explained  35.2  6.7  5.0  4.5  4.0 
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Eigenvalue  11.10  1.92 

Percent  Variance 

Explained  37.0  6.4 


APPENDIX  C 

ORGANIZATIONAL  CLIMATE  FACTOR  ITEM  INTERCORRELATIONS 
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Table  C-l 

Item  Intercorrelations:  Climate  Factor  One 
Immediate  Work  Group  (N  =  1061) 


Table  C-2 

Item  Intercorrelations:  Climate  Factor  Two 
Employee/Supervisor  Interactions  (N  =  106l) 


OlB  Q19 

Q21 

025 

Q29 

030 

Q43 

Q18 

1.0  .51 

•  32 

.41 

•  56 

.40 

■  43 

Q19 

1.0 

•  33 

•  56 

.49 

.60 

■  56 

Q21 

1.0 

■  35 

•  35 

■  31 

.26 

Q2  5 

1.0 

.45 

■  38 

.43 

Q29 

All  correlations 

1.0 

.48 

.46 

'Q30 

significant 

p  <  .001 

at 

1.0 

•  51 

■Q43 

1.0 

4 
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Table  C-3 

Item  Intercorrelations:  Climate  Factor  Three 
Organizational  Warmth  (N  =  1061) 


Q20  Q23  Q29 

Q33 

Q34 

Q36 

Q4l 

Q44 

Q20a 

1.0  -.26  -.31. 

-.42 

-•33 

-.35 

-.35 

-.32 

Q23 

1.0  .33 

•  31 

.49 

.37 

.38 

.36 

Q29 

1.0 

L* 

• 

.61 

•  35 

.29 

•  45 

Q33 

1.0 

.44 

•  39 

.36 

.42 

Q34 

All  correlations 

1.0 

.41 

.41 

.45 

Q36 

significant  at 

p  <  .001 

1.0 

.42 

.45 

Q4l 

1.0 

.49 

q44 

1.0 

Table  C-4 

Item  Intercorrelations:  Climate  Factor  Four 
Organizational  Communication  (N  =  106l) 


Ql6 

Q4l 

Q42 

Q45 

Ql6 

1.0 

•  36 

.61 

•  56 

Q4l 

1.0 

.39 

.49 

Q42 

1.0 

.66 

Q45 

1.0 

All  correlations 

signi ficant 

at  p  <  .001 

Table  C-5 

Item  Intercorrelations:  Climate  Factor  Five 
Supervisory  Support  (N  =  1061) 


Q24  Q37 

Q4o 

Q43 

Q24  1.0  .62 

.34 

.54 

Q37  1.0 

•  38 

.63 

Q40 

1 .0 

•  33 

Q43 

1.0 

All  correlations  significant 

at  p  <  .001 
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Table  D-l# 

Item  Intercorrelations t  Productivity  Factor  One 
External  Professional  Development  (N  =  685) 


Q51 

Q54 

.  Q51 

1.0 

.44 

Q54 

1.0 

Table  D-2^ 

Item  Intercorrelations;  Productivity  Factor  Two 
Technical  Data  (N  =  685) 


Q52 

Q53 

Q52 

1.0 

■  35 

Q53 

1.0 

Table  D-3# 

Item  Intercorrelations s  Productivity  Factor  Three 
Management  Studies  (N  =  685) 


056 

Q57 

Q56 

1.0 

.45 

Q57 

1.0 

#  All  correlations  significant  at  p  <  .001 
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APPENDIX  E 

DATA  ANALYSIS  FOR  HIERARCHICAL  GROUPS 
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Table  E-2 

Differences  Among  Divisions  on  Patchen  Scores t 
Hierarchical  Groups  (1978)  # 
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Table  E-7 

Differences  Among  Divisions  on  Organizational 


Table  E-8 

Differences  Among  Divisions  on  Hoppock  Scores i 
Hierarchical  Groups  (1979) 


Table  E-10 


Table  E-ll 


Table  E-13 

Differences  Among  Divisions  on  Organizational 
Climate  Factor  Foun  Hierarchical  Groups  (1979)  # 
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#  None  of  the  above  results  are  statistically  significant 
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Differences  Among  Divisions  on  Patchen  Scores i 
Hierarchical  Groups  (1980)  # 
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Table  E-lB 

Differences  Among  Divisions  on  Organizational 
Climate  Factor  Twoi  Hierarchical  Groups  (19^0) 


Table  E-19 

Differences  Among  Divisions  on  Organizational 


Table  E-20 

Differences  Among  Divisions  on  Organizational 
Climate  Factor  Fourt  Hierarchical  Groups  (1980)  # 


Table  E-21 

Differences  Among  Divisions  on  Organizational 
Climate  Factor  Five:  Hierarchical  Groups  (1980) 


APPENDIX  F 

1979  SURVEY  ITEM  RESPONSES 
(MEAN/STANDARD  DEVIATION) 


Table  FI 

Survey  Item  Responses* 
(1979) 


Question 

Short  Name 

Mean/Std  Deviation 
1979 

1 

Age 

3.45/2.16 

2 

Grade 

3.74/1.55 

3 

Years  in  Division 

5.53/1.86 

4 

Years  in  Lab 

3.36/1.72 

5 

Education  Level 

4.79/1.67 

6 

Division 

a 

7 

Position 

2.93/1*14 

8 

Hoppock-1 

4.87/1.23 

9 

Hoppock-2 

4.94/1 .00 

10 

Hoppock-3 

4.69/1.05 

11 

Hoppock-4 

4.51/  .90 

12 

Patch en-1 

3.96/1.18 

13 

Patchen-2 

3.22/  .76 

14 

Patchen-3 

3.41/1.24 

15 

Patchen-4 

3.71/  .82 

16 

Info:  Group 

3.27/1.29 

17 

Objectives 

3.86/  .81 

18 

Credit  for  Work 

3.53/1.23 

19 

Supv  Pays  Attn 

3.73/  -95 

20 

Organ' 1  Loyalty 

3.09/1.15 

21 

Autonomy 

4.13/1.02 

22 

Group  Friendly 

4.17/  .94 

23 

Promot  Sys  Effectv 

2.32/1.14 

24 

Supv  Hi  Standards 

3.68/  .94 

25 

Supv  Esteem 

3.31/  .87 

26 

Group  Help 

2.76/1.02 

27 

Know  What's  Exptd 

3.80/1 .00 

28 

Group  Plan 

3.11/1.04 

*N  (1979) 
a  =  N/A 

=  412 

142 


Table  FI  (corrt'd)** 


Questior 

Short  Name 

Mean/Std  Deviation 

29 

Rewards  GT  Criticism 

3. 3^/1. 24 

30 

Supv  Friendly 

4.19/  -99 

31 

Group  Pays  Attn 

3.66/  .74 

32 

Group  Exchg  Ideas 

3-54/  .82 

33 

Organizational  Pride 

3.60/1.03 

34 

Rewards 

2.76/1.12 

35 

Group  Trust 

3.65/  .89 

36 

Decisions 

2.65/1.09 

3? 

Supv  Encourage  Best 

3.54/  .92 

Effort 

38 

Group  Sharing 

3.69/  .83 

39 

Influence  Decisions 

3-37/1.20 

40 

Pressure  to  Improve 

3.00/1 .04 

41 

Info:  Sharing 

2.56/1.05 

42 

Info:  Branch 

3.27/1.13 

43 

Supv  Encourages  Ideas 

3-37/  .95 

44 

People  Asked  Ideas 

2.91/  .99 

45 

Info:  Division 

2.32/1.13 

46 

R&D  (In-House) 

26.85/25.32 

47 

Contract  Guidance 

20 . 25/20 . 37 

48 

Technical  Support 

16.33/18.31 

49 

Program  Admin 

25.59/20.66 

50 

Supervision 

9.75/17.06 

51 

Published  Papers 

.34/  .75 

52 

Technical  Reports 

.37/  .71 

53 

Technical  Memos 

.74/1 .46 

54 

Presentations 

.79/1.26 

55 

Specifications 

1.84/2.88 

56 

In-House  Studies 

1.57/3.21 

57 

Gen  Officer  Briefings 

1.19/2.23 

58 

Committee  Partic 

.87/1.40 

**For 

Questions  46-58,  N  (1979)  =  2 

’45 

143 


APPENDIX  G 
FACTOR  TREND  PLOTS 
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Figure  G-6  Factor  Trend  Floti  Climate  Factor  Four 
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Figure  G-9  Factor  Trend  Plot:  Productivity  Factor  Two 


1 


( 


APPENDIX  H 

REVIEW  OF  WRITTEN  COMMENTS  BY  AFFDL  PERSONNEL 


155 


As  a  result  of  the  number  of  unsolicited  written 


comments  received  by  Dekok  on  his  surveys  in  1979 »  a  comment 
page  was  added  to  survey  for  the  1980  measurement.  Several 
of  the  comments  already  presented  provided  insight  into 
several  areas.  This  appendix  contains  no  specific  comments 
concerning  the  OD  program  at  AFFDL.  Several  of  the  questions 
in  the  questionnaire  generated  comments  which  revealed  pro¬ 
blems,  or  perceived  problems,  by  AFFDL  personnel  in  three 
areas:  organizational  objectives,  communication  within  the 
laboratory,  and  promotions.  These  comments  are  provided  as 
background  information  on  perceptions  of  employees  at  AFFDL. 

1 .  Organizational  Objectives. 

A  number  of  personnel  questioned  the  existence  of 
specific  objectives  for  AFFDL.  These  responses  referred  not 
to  objectives  for  the  OD  program  but  to  the  laboratories' 
normal  stated  objectives.  Two  written  comments  which  were 
representative  are: 

Organizational  Objectives:  If  there  are  any, 

I've  never  heard  what  they  are!  Why  doesn’t  some¬ 
body  communicate  with  us?  How  can  I  support  organ¬ 
izational  objectives  if  I  don’t  know  what  they  are 
[GS-13  in  FBJ? 

I  don’t  believe  the  laboratory  has  a  clear-cut, 
simple  concise  statement  of  objectives  [FG  employee]. 

2 .  Communications  Within  the  Laboratory 

A  number  of  personnel  perceived  a  breakdown  in 
communications  above  the  branch  level.  Several  cited  staff 


actions  as  examples  of  this  lack  of  communication.  One 
S&E  wrote: 

The  atmosphere  of  cooperation  and  friendship 
through  branch  level  is  outstanding.  Beyond  that 
level  it  begins  to  break  down.  There  appears  to 
be  less  concern  for  the  working  engineer  beyond 
branch  level  [S&E  in  FX] . 

3 .  Promotions 

Many  personnel  saw  promotions  as  a  key  issue  in  the 
areas  of  job  motivation,  job  satisfaction  and  retention. 

The  question  in  the  survey  on  promotion  policy,  Q23,  scored 
the  lowest  of  any  of  30  climate  questions  in  all  three 
measurements.  The  following  written  comments  were  typical: 

Morale  is  poor.  .  .  .  Promotion  policy  makes 
it  difficult  to  maintain  incentive.  As  I  look 
ahead,  I  see  no  future  gains  [S&E  in  FX] . 

Our  only  avenue  for  substantial  raises  in 
salary  is  through  promotions,  which  have  been 
very  few  and  slow  for  several  years.  This  has 
been  a  major  problem  in  recruiting  for  the  labs 
and  in  retaining  good  people  [S&E  in  FG] . 

While  two  AFFDL  employee's  questioned  the  unefulness 
of  the  survey  and  questionnaire,  one  individual  found  an  un¬ 
expected  use  for  it  and  wrote: 

After  answering  the  questions  it  is  obvious 
that  I  have  my  own  problem  areas  which  need  improve¬ 
ment  [FX  employ eel. 
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